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ABSTRACT 


This  thesis  examines  the  "Problem  Solving  Skills  for 
Managers"  training  package,  piloted  by  the  Coast  Guard 
Leadership  and  Management  School  in  April  1983.  Four  ques¬ 
tionnaire  instruments  developed  by  the  company  which  pro¬ 
duced  the  training  package  were  analyzed  to  determine  the 
effectiveness  of  the  training  program.  A  quasi-exper imen- 
tal  pre-test /post-test /control  group  research  design  was  used 
by  the  Coast  Guard  project  manager  and  this  thesis  used  a 
regression  procedure  to  counteract  any  regression  effect. 

The  results  of  the  analysis  suggest  that  the  training  program 
was  not  effective  as  given  and  suggests  further  study  to 
determine  why  it  was  not  effective. 
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I. 


INTRODUCTION 


"The  dollar  spent  on  training  today  is  a  marginal 
dollar.  Today,  more  than  ever,  training  professionals 
must  demonstrate  the  effectiveness  of  their  programs.... 
Spending  money  on  unnecessary  training,  inappropriate 
training,  or  training  that  doesn't  train  can  spell 
disaster  for  those  who  design  such  programs."  [Ref.  1] 

A .  BACKGROUND 

These  introductory  remarks  were  written  by  a  learning 
technology  manager  in  industry,  but  they  apply  equally  well 
to  the  government  sector  in  general  and  to  the  Coast  Guard 
in  particular.  Training  plays  a  vital  role  in  preparing 
Coast  Guard  personnel  for  the  increasingly  complex  skills 
required  to  meet  the  challenges  of  technological  growth. 
Training  is  required  to  insure  that  the  Coast  Guard  can 
take  advantage  of  modern  technology  by  using  all  of  its 
resources  as  effectively  and  efficiently  as  possible.  These 
include  financial,  physical  and  human  resources.  It  has 
been  said  that  people  are  the  Coast  Guard's  most  important 
asset. *  Leadership  has  traditionally  been  important  in  the 
military  services  to  insure  the  "good  order  and  discipline" 
of  these  assets.  The  effective  management  of  these  human 
resources  becomes  even  more  important  as  increasing  amounts 


*For  example,  see  former  Coast  Guard  Commandant  Admiral 
John  B.  Kayes'  State  of  the  Coast  Guard  address  of  16 
January  1979. 
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of  time  and  money  are  invested  in  their  training  and  develop¬ 
ment.  This  is  one  of  the  reasons  that  leadership  and  manage¬ 
ment  training  is  provided  to  those  in  supervisory  positions. 

The  Coast  Guard  recognizes  the  need  to  efficiently  use 
these  training  dollars  and  has  prescribed  the  responsibili¬ 
ties  and  techniques  for  training  management  [Ref.  2].  One 
of  the  techniques  is  the  use  of  Instructional  Systems 
Development  (ISD),  a  method  of  identifying  training  needs, 
determining  the  optimal  training  methods,  developing  an 
appropriate  training  design,  implementing  and  evaluating 
the  training.  A  diagram  of  the  basic  ISD  process  is  provided 
by  Figure  1.1. 

This  thesis  will  examine  the  "Problem  Solving  Skills  for 
Managers"  training  package,  developed  by  Interact  Performance 
Systems,  Incorporated,  in  1982,  and  piloted  by  the  Coast 
Guard  Leadership  School  during  the  period  5  April  1983  through 
2  August  1983.  The  main  objective  of  the  training  is  for 
supervisors  to  increase  their  effectiveness  in  dealing  with 
interpersonal  problems  in  their  work  settings  by  using  the 
steps  in  the  problem  solving  process  that  are  described  in 
the  training.  In  this  particular  training  program,  parti¬ 
cipants  learn  to  communicate  the  situation  in  a  specific 
and  non-threatening  manner;  to  diagnose  the  situation  as  an 
ability  or  a  motivation  problem;  to  communicate  the  conse¬ 
quences — natural  (e.g.  the  job  will  not  get  done),  to  others, 
to  the  supervisor,  or  imposed — until  compliance  is  gained; 
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to  determine  who  does  what/when  and  set  a  follow-up  date; 
how  to  find  long-term  solutions;  and  how  to  deal  with  emer¬ 
gent  problems.  The  process  involves  extensive  use  of  video¬ 
taped  modules  showing  both  ineffective  and  effective 
behaviors,  structured  role-playing  and  group  discussions. 

The  training  is  given  in  a  series  of  four  one-day  segments, 
one  segment  per  week.  After  each  training  segment,  partici¬ 
pants  "contract"  to  practice  their  skills  during  the  week 
and  to  report  their  results  when  the  class  next  meets. 

B.  PURPOSE 

The  purpose  of  this  thesis  is  to  accomplish  a  portion  of 
the  evaluation  phase  required  by  ISD  [Ref.  2],  and  in 
particular  the  internal  evaluation  of  the  "Problem  Solving 
Skills  for  Managers"  training  package  piloted  by  the  Coast 
Guard  Leadership  School  during  the  period  5  April  1983 
through  2  August  1983.  (The  other  phases  of  the  ISD  process 
in  relation  to  this  training  package  will  not  be  discussed 
in  this  thesis  and  are  assumed  to  have  been  completed  prior 
to  this  stage.)  Internal  evaluation  refers  to  an  analytical 
means  of  measuring  the  instruction  process  by  determining 
student  reaction  or  degree  of  behavioral  change  attributed 
to  the  actual  training  [Ref.  2].  The  instruments  used  to 
measure  the  instruction  process  consist  of  a  series  of  ques¬ 
tionnaires  designed  by  the  developer  of  the  training  process. 
The  training  was  conducted  by  a  staff  member  of  the  Coast 
Guard  Leadership  and  Management  School.  The  data  was 
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collected  and  a  computerized  data  base  established  by  the 
leadership  school  staff.  The  purpose  of  this  thesis  is 
to  analyze  the  data  and  make  a  determination  of  the  effec¬ 
tiveness  of  the  training  package. 


15 


I I .  METHODOLOGY 


A.  RESEARCH  SETTING  AND  DESIGN 

The  "Problem  Solving  Skills  for  Managers"  training 
package  was  presented  to  supervisors  at  four  Coast  Guard 
stations  in  the  Twelfth  District  (San  Francisco  area)  as  a 
pilot  program  with  the  goal  of  determining  if  the  training 
should  be  pursued  on  a  larger  scale  within  the  Coast  Guard. 
Two  stations  were  trained  initially  while  the  remaining  two 
stations  were  used  as  a  "control  group."  These  "control 
group"  stations  subsequently  received  the  same  training. 

For  clarity  and  consistency  throughout  this  thesis,  the 
first  group  to  receive  the  training  will  be  referred  to  as 
the  "Early  Treatment  Group"  and  the  second  group  to  receive 
the  training  as  the  "Late  Treatment  Group"  (see  Figure  2.1). 

The  first  portion  of  the  training  design  used  by  the 
Coast  Guard  Leadership  and  Management  School  Project 
Manager /Trainer  is  referred  to  as  a  quasi-exper imental , 
non-equivalent  control  group  design  [Ref.  3].  It  involves 
an  experimental  group  and  a  control  group  ("early"  and 
"late"  treatment  groups,  respectively),  both  given  pre-  and 
post-measures.  The  early  group  and  late  group  do  not  have 
pre-exper imental  sampling  equivalence.  These  groups  consti¬ 
tute  the  "naturally  assembled  collectives"  of  four  Coast 
Guard  stations,  matched  as  closely  as  possible  for  size 


16 


17 


(total  numbers  of  people  assigned,  supervisors  and  subordi¬ 
nates  combined)  and  organizational  profile  (operational 
mission,  common  group  commander,  rank  of  those  in  leadership 
positions  within  the  organizational  structure).  That  is, 
the  participants  are  not  randomly  selected  or  assigned  to 
these  groups  as  a  "true"  experimental  design  would  require. 
The  assignment  of  the  treatment  to  one  group  or  another  is 
assumed  to  be  random  and  under  the  researcher's  control. 

The  training  was  conducted  at  each  station  by  the  same 
experienced  instructor  from  the  Coast  Guard  Leadership  and 
Management  School  in  Petaluma,  California.  The  data 
collected  with  the  measurement  instruments  was  transcribed 
by  the  Management  School  staff  to  form  a  raw  computerized 
data  base.  This  researcher  organized  the  data  base  into 
four  files,  one  for  each  type  of  questionnaire,  for  subse¬ 
quent  analysis. 

B.  INSTRUMENTATION 

The  same  pre-measures  and  post-measures  were  given  to 
each  of  the  control  and  experimental  groups,  and  consisted 
of  a  set  of  four  questionnaires  that  were  administered  at 
the  points  in  the  training  design  as  shown  in  Figure  2.1. 
These  questionnaires  were  designed  by  the  company  that 
developed  and  produced  the  training  package. 


18 


1 .  Subordinate  Organization  Survey  (SUBQ) 


This  questionnaire  consists  of  three  parts:  demo¬ 
graphics;  subordinates'  perception  of  organizational 
climate,  satisfaction  and  commitment;  and  subordinates' 
perception  of  their  supervisors'  behavior  in  dealing  with 
problems.  It  was  completed  by  the  subordinates  of  the 
supervisors  who  received  or  were  scheduled  to  receive  the 
training  at  each  of  the  stations.  The  demographic  informa¬ 
tion  section  was  completed  only  at  the  first  administration 
of  this  questionnaire. 

2 .  Supervisory  Organization  Survey  (SUPQ) 

This  questionnaire  also  consists  of  three  parts: 
demographics;  supervisors'  perception  of  organizational 
climate,  satisfaction,  and  commitment;  and  knowledge  of 
problem  solving/organizational  support.  The  supervisors  who 
received  or  were  scheduled  to  receive  the  training  completed 
all  portions  of  this  questionnaire  at  each  administration, 
except  for  the  demographics  section,  which  was  completed 
only  for  the  first  administration. 

3 .  Multiple  Choice  Questionnaire  (MCQ) 

This  questionnaire  was  completed  at  each  administra¬ 
tion  by  each  of  the  supervisors  who  received  or  were  sched¬ 
uled  to  receive  the  training.  It  was  designed  to  measure 
understanding  of  problem  solving  skills  (categorical  and 
episodic ) , 
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4 .  Supervisory  Evaluation  of  Training  (SETQ) 

This  questionnaire  was  completed  by  supervisors  on 
the  administration  following  completion  of  the  training. 

It  was  designed  to  measure  the  supervisors'  reaction  to  the 
training  program  and  their  motivation  as  determined  by 
intrinsic  factors  (e.g.  recognize  the  positive  natural 
consequences  of  using  the  problem  solving  skills)  and 
extrinsic  factors  (e.g.  organization  support). 

Copies  of  all  four  of  these  instruments  are  included 
as  Appendix  A.  Each  of  these  questionnaires  uses  codes  to 
identify  the  subordinates  and  supervisors  within  the  data 
base  for  cross-referencing  or  comparing  results  based  on 
subordinate  or  supervisor  responses  on  each  variable,  while 
maintaining  the  anonymity  of  the  participants.  The  coding 
of  the  questionnaires  is  explained  in  the  introduction  to 
the  appendix. 

C.  SAMPLE 

The  data  collected  from  these  four  measurement  instru¬ 
ments  was  based  on  a  combined  sample  (N  =  111)  of  subordi¬ 
nates  and  a  combined  sample  (N  =  38)  of  supervisors  who 
received  the  training  at  the  four  stations.  (The  subordi¬ 
nate  sample  size  refers  to  the  number  of  questionnaires 
filled  out  at  each  administration  by  subordinates;  there 
were  actually  a  total  of  52  subordinates,  some  of  whom 
completed  questionnaires  for  more  than  one  supervisor.)  A 
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portion  of  the  supervisors  who  received  the  training  and 
completed  the  Supervisory  Organization  Surveys  were  also 
considered  to  be  subordinates  and  filled  out  the  Subordinate 
Organization  Surveys  as  well.  These  dual-role  cases  were 
not  identified  in  the  data  base  and  could  not  be  distin¬ 
guished.  This  could  be  a  source  of  contamination  of  the 
results  noted  in  this  study  and  will  be  discussed  further  in 
chapter  four.  Table  I  shows  the  breakdown  of  supervisors 
and  subordinates  for  each  unit. 


Table  I 

Sample  Sizes  by  Unit  and  Category 


Unit 

Category 

Subordinates  Supervisors 

E300 

035 

Oil 

E500 

021 

007 

C400 

028 

Oil 

C600 

027 

009 

Total 

111 

038 

Note:  E  identifies  the  Early  Treatment  Group  and 

C  identifies  the  Late  Treatment  Group. 


Although  the  stations  selected  by  the  Coast  Guard  Project 
Manager /Trainer  were  matched  In  pairs  as  closely  as  possible 
for  size  and  organization  profile,  this  thesis  will  not 
analyze  the  data  obtained  in  terms  of  ’’matched''  pairs  of 
units.  If  matching  was  to  be  used  as  an  attempt  to 
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compensate  for  the  differences  between  non-equivalent  control 
groups  when  random  assignment  to  experimental  and  control 
conditions  is  not  possible,  it  may  not  only  fail  to  provide 
the  desired  equivalence,  but  in  certain  circumstances  may 
actually  assure  the  presence  of  unwanted  regression  effects 
[Ref.  3].  The  data  samples  will  therefore  be  aggregated  and 
compared  as  early  treatment  vs.  late  treatment  groups. 

D .  PROCEDURE 

A  number  of  hypotheses  regarding  change  as  a  result  of 
the  training  will  be  examined  to  determine  the  effectiveness 
of  this  training  program.  Effectiveness  can  be  evaluated  in 
terms  of  reaction,  learning,  behavioral  and/or  results 
criteria  [Ref.  4].  Each  is  used  to  examine  different 
aspects  of  the  program.  Reaction  criteria  measure  how  well 
the  participants  liked  the  program.  People  are  more  likely 
to  obtain  maximum  benefit  from  a  program  they  enjoy. 

Reaction,  then,  provides  one  means  of  identifying  reasons 
for  the  success  or  failure  of  a  training  program.  Learning 
refers  to  the  knowledge  and  skills  absorbed  by  the  partici¬ 
pants.  Behavior  is  the  transfer  of  the  knowledge  and  skill 
to  actual  performance  on  the  job.  Results  criteria  can  be 
cost-related  (lower  cost,  increased  efficiency)  or  behavioral 
(reduced  absenteeism,  attrition,  disciplinary  involvements) 
measures,  which  give  evidence  of  the  training's  impact  on 
organizational  effectiveness.  Because  of  many  complicating 
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factors,  however,  it  is  very  difficult  to  evaluate  in  terms 
of  results  [Ref.  4]. 

1 .  Approach 

This  thesis  will  examine  the  effectiveness  of  the 
training  program  primarily  in  terms  of  learning  and 
behavior. 

a.  Learning 

Learning  will  be  analyzed  in  terms  of  the 
results  of  the  Multiple-Choice  Questionnaire  (MCQ).  Although 
the  Supervisory  Organization  Survey  (third  part)  also  seems 
to  measure  participant  knowledge,  it  appears  to  be  somewhat 
redundant  to  the  MCQ  and  will  not  be  examined  in  this 
analysis.  The  data  base  was  recoded  so  that  the  desired 
answer  received  a  value  of  one  and  all  other  answers  a 
value  of  zero,  A  score  for  each  participant  was  then 
computed  as  a  percentage  correct  of  the  questions  answered. 

b.  Behavior 

Behavior  will  be  analyzed  in  terms  of  the 
results  of  the  Subordinate  Organization  Survey  (SUBQ),  Part 
III.  To  determine  if  any  of  the  fifty  variables  (questions) 
could  be  combined  and  scaled  in  order  to  reduce  the  number 
of  data  comparisons  required,  the  data  from  the  first  admin¬ 
istration  of  SUBQ  Part  III  was  subjected  to  factor  analysis 
using  principal  factoring  with  iteration  and  varimax 
(orthogonal)  rotation  Nine  factors  were  identified.  Using 
the  Scree  Test  [Ref.  5:  pp .  152-156],  a  plot  of  Eigenvalue 
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vs.  factor  number  (see  Figure  2.2),  it  was  determined  that 
two  factors  were  the  primary  contributors.  The  first  two 
factors  accounted  for  most  (77.3%)  of  the  variance  in  that 
data  set.  Therefore,  a  second  factor  analysis  was  made 
with  only  two  factors  extracted.  The  factor  loadings  from 
the  varimax  rotated  factor  matrix  were  used  to  assign  each 
variable  to  one  of  the  two  factors  based  on  the  weight  of 
the  factor  for  that  variable.  In  reviewing  the  questions 
that  loaded  on  each  factor,  it  appears  that  the  first  factor 
relates  to  "problem  solving  support"  (where  a  high  rating 
indicates  more  support)  and  that  the  second  factor  relates 
to  "passing  the  buck"  with  regard  to  problem  solving  (where 
low  rating  indicates  less  "passing  the  buck").  Table  II 
provides  a  listing  of  the  variables  assigned  to  the  first 
factor,  the  corresponding  questionnaire  question  and  the 
appropriate  factor  loading,  in  descending  order  of  factor 
loading.  Table  III  provides  the  same  information  for  the 
second  factor. 

The  values  of  the  variables  included  in  each 
factor  were  then  combined  into  an  average  value  for  each 
subordinate,  so  that  only  two  variables  would  have  to  be 
examined  to  describe  behavior.  A  listing  of  the  means  and 
standard  deviations  of  each  variable  and  the  correlation 
matrix  for  the  input  variables  are  included  in  Appendix  B. 


Table  II 


SUBQ  Part  III  Factor  One — Problem  Solving  Support 


Factor 


Variable 

Quest  ion 

Loading 

SUBQ1090 

Does  your  supervisor  take  action  in  a 
timely  way  to  solve  complaints  you 
bring  to  his  or  her  attention? 

.81498 

SUBQ117A 

Does  your  supervisor  try  to  find  ways 
to  make  the  job  easier  in  the  future? 

.78898 

SUBQ109J 

Is  your  supervisor  supportive  in 
solving  work  related  problems  you  want 
help  with? 

.78832 

SUBQ109K 

Does  your  supervisor  bring  resources 
to  bear  to  help  you  solve  problems 
on  the  job? 

.78726 

SUBQ114B 

To  what  extent  does  your  supervisor 
explain  how  correcting  a  problem 
affects  the  job? 

.77771 

SUBQ109N 

Is  your  supervisor  quick  to  follow 
through  on  problems  you  bring  to  his 
or  her  attention? 

.76761 

SUBQ109A 

Does  your  supervisor  keep  up-to-date 
with  the  problems  you  are  experiencing 
on  the  job? 

.76639 

SUBQ117B 

Is  your  supervisor  concerned  about 
making  the  job  less  difficult  the 
next  time  you  have  to  do  it? 

.76197 

SUBQ118C 

Can  you  be  sure  that  your  supervisor 
will  really  follow  up  to  see  that  the 
problem  is  solved? 

.75299 

SUBQ110B 

To  what  extent  is  your  supervisor  clear 
about  the  facts  of  problems? 

.74615 
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SUBQ114A 

When  discussing  a  problem,  to  what 
extent  does  your  supervisor  clearly 
explain  what  would  go  wrong  with  the 
job  if  the  problem  weren't  corrected? 

. 7  4586 

— 

SUBQ109C 

Does  your  supervisor  take  time  to  ask 
you  whether  there  are  ways  he  or  she 
can  help  make  your  job  easier? 

.  74553 

■  ■ 

SUBQ109B 

Does  your  supervisor  take  time  dis¬ 
cussing  your  point  of  view  on  your 
work? 

.73757 

1 

SUBQ118D 

Are  you  able  to  trust  that  your 
supervisor  will  do  what  the  two  of 
you  have  agreed  needs  to  be  done? 

.73488 

1 

SUBQ112C 

Accurately  summarize  your  feelings 
on  the  matter? 

.72400 

.  | 

SUBQ109D 

Does  your  supervisor  come  to  your 
work  area  to  ask  you  whether  you 
need  any  help  to  make  your  job  easier? 

.69524 

-  M 

% 

1 

SUBQ116B 

To  what  extent  does  your  supervisor 
show  respect  for  your  ideas  and 
abilities  on  the  job? 

.68101 

« 

SUBQ116A 

To  what  extent  does  your  supervisor 
treat  you  in  a  way  that  shows  he  or 
she  values  your  experience  and  opinions 
on  the  job? 

.68007 

SUBQ112B 

Demonstrate  by  restating  that  he  or  she 
fully  understands  the  point  you  are 
tring  to  make? 

.64727 

n 

SUBQ112D 

Carefully  listen  without  arguing  or 
becoming  upset? 

.64726 

i 

SUBQ119D 

When  dealing  with  an  upset  subordinate, 
to  what  extent  does  your  supervisor  ask 
the  person  what  is  bothering  him  or  her? 

.64267 

SUBQ119C 

When  dealing  with  an  upset  subordinate, 
to  what  extent  does  your  supervisor  ask 

.63689 

what  has  made  the  person  upset  or  angry? 


9. 
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SUBQ120B 


.61350 


When  you  have  done  a  good  job,  to 
what  extent  does  your  supervisor 
express  his  or  her  appreciation 
for  what  you  have  done? 

SUBQ110A  When  your  supervisor  brings  up  a  .57595 

problem,  to  what  extent  is  he  or  she 
clear  about  exactly  what  is  bothering 
him  or  her? 

SUBQ112A  Listen  to  your  point  of  view  without  .54005 

interrupting  or  cutting  you  off? 


Table  III 

SUBQ  Part  III  Factor  Two — Passing  the  Buck 


Factor 

Variable  Quest  ion  Loading 

SUBQ113B  To  what  extent  does  your  supervisor  .73719 

"shoot  from  the  hip"  when  solving 
problems  instead  of  stopping  to  learn 
about  the  problem  first? 

SUBQ113C  To  what  extent  does  your  supervisor  .73368 

blame  you  for  problems  that  aren't 
your  fault? 

SUBQ111B  To  what  extent  does  your  supervisor  .72942 

draw  conclusions  about  you  as  a  person 
when  discussing  problems? 

SUBQ111A  To  what  extent  does  your  supervisor  .72151 

put  you  down  when  describing  problems? 

SUBQ115B  When  answering  questions  about  why  .69534 

something  must  be  done  a  certain  way, 
to  what  extent  does  your  supervisor 
threaten  you  with  what  might  happen  if 
you  don’t  do  what  he  or  she  wants? 

SUBQ109G  Does  your  supervisor  give  you  excuses  .68467 

for  not  solving  that  show  you  he  or  she 
won't  "go  to  bat"  for  you? 
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SUBQ109M 

SUBQ113A 

SUBQ113D 

SUBQ121A 

SUBQ121B 

SUBQ119A 

SUBQ115C 

SUBQ109P 

SUBQ118B 

SUBQ120A 

SUBQ119B 


Does  your  supervisor  promise  to  see  what 
can  be  done  about  a  problem  but  then 
never  let  you  know  what  he  or  she  did  to 
solve  it? 

To  what  extent  does  your  supervisor 
impose  a  solution  to  a  problem  without 
first  stopping  to  figure  out  what  is 
going  on? 

When  discussing  a  problem  with  you,  to 
what  extent  does  your  supervisor  assume 
you're  the  cause  of  the  problem  when 
you're  not? 

Does  your  supervisor  act  in  ways 
that  make  it  hard  to  trust  him  or 
her? 

Does  your  supervisor  tell  you  whatever 
he  or  she  thinks  you  want  to  hear  in 
order  to  get  you  to  do  what  he  or  she 
wants? 

When  dealing  with  an  upset  subordinate, 
to  what  extent  does  your  supervisor 
get  angry  at  him  or  herself? 

When  answering  questions  about  why 
something  must  be  done  a  certain  way, 
to  what  extent  does  your  supervisor  use 
his  or  her  "stripes"  as  your  supervisor 
+0  get  you  to  do  what  he  or  she  wants? 

Does  your  supervisor  get  on  your  case 
too  much  about  little  things  that  are 
not  worth  the  time  they'd  take  to  fix? 

Is  it  left  unclear  as  to  who  will  do 
what  to  solve  the  problem? 

When  you  have  done  well  on  the  job, 
to  what  extent  does  your  supervisor 
express  his  or  her  appreciation  for 
what  you  have  done? 

When  dealing  with  an  upset  subordinate, 
to  wnat  extent  does  your  supervisor  got 
into  an  argument? 


.  66854 

.66449 

.66365 

.65113 

.63465 

.62128 

.61915 

.59848 

.59216 

.  56787 

.56011 
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.55227 


SUBQ115A  When  answering  questions  about  why 

something  must  be  done  a  certain  way  , 
to  what  extent  does  your  supervisor 
order  you  to  do  it  the  way  he  or 
she  wants? 


3UBQ118A 

SUBQ109L 

SUBQ109I 

SUBQ109F 

SUBQ109H 

SUBQ109E 


Does  your  supervisor  leave  you  guessing  .55187 
about  what  should  happen  next? 

Does  your  supervisor  say  he  or  she  will  .55185 
take  action  on  a  problem  but  then  never 
get  back  to  you  to  solve  it? 

Does  your  supervisor  refuse  to  take  .53738 

on  the  people  in  power  in  order  to 
remove  complaints  in  your  department? 

Does  your  supervisor  fail  to  deal  with  .52699 
problems  before  they  become  severe? 

Is  your  supervisor  unwilling  to  argue  .45610 
or  fight  for  you  to  solve  problems 
you  bring  up? 

Does  a  problem  have  to  get  out  of  hand  .45293 
before  your  supervisor  chooses  to  deal 
with  it? 


c.  Results 

One  method  of  examining  the  impact  on  organiza- 

2 

tional  effectiveness  is  to  measure  the  subjects  views  on 
organizational  climate,  satisfaction  and  commitment  and  see 
if  they  change  after  training.  The  Subordinate  Organization 
Survey  Part  II  and  the  Supervisory  Organization  Survey  Part 
II  ask  questions  in  these  categories  (see  Appendix  A)  which 
are  similar  to  some  of  the  questions  in  the  related  sections 


2 

"Subjects"  as  used  here  refers  to  both  supervisors  and 
subordinates  who  were  measured  on  these  factors. 
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of  the  Michigan  Survey  of  Organizations  [Ref.  6].  Again,  in 
an  effort  to  determine  the  possibility  of  simplifying  the 
data  base,  the  variables  in  SUBQ  Part  II  Administration  1 
were  subject  to  factor  analysis  using  principal  factoring 
with  iteration  and  varimax  (orthogonal)  rotation.  The 
results  indicated  that  the  questions  relating  to  organiza¬ 
tional  climate  could  be  considered  as  a  single  factor.  For 
satisfaction,  SUBQ107E  (satisfaction  with  pay)  was  not 
related  to  the  other  variables,  so  it  was  not  included  in 
the  scale  for  satisfaction  (the  other  items  accounted  for 
78.7  percent  of  the  variance).  For  commitment,  the  results 
indicated  that  the  three  questions  could  be  considered  one 
factor.  Although  the  scree  test  was  inconclusive,  Guttraan's 
procedure  [Ref.  5:  p.  147]  for  estimating  the  lower  bound 
for  the  number  of  factors  suggests  using  the  factors  with 
eigenvalues  greater  than  or  equal  to  1.0,  leading  to  the 
selection  of  one  factor  for  commitment.  The  scree  test 
plots  are  shown  in  Figure  2.3,  Figure  2.4  and  Figure  2.5. 

A  listing  of  the  eigenvalues,  means  and  standard  deviations 
of  each  variable  and  the  correlation  matrix  for  the  input 
variables  are  included  in  Appendix  C.  These  factors  were 
applied  for  each  administration  of  both  SUBQ  Part  II  and 
SUPQ  Part  II.  The  values  of  the  variables  included  in  each 
factor  were  then  combined  into  an  average  value  for  each 
respondent  so  that  only  three  variables  would  have  to  be 
examined  to  describe  "Results." 
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Figure  2.4  Scree  Test  for  Satisfaction 
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2 .  Hypotheses  to  be  Tested 


Figure  2.6  shows  the  relationships  to  be  examined. 

In  each  case,  the  null  hypothesis  <Ho)  is  that  there  is  "no 
change."  Each  hypothesis  will  be  described  in  detail  below. 


Figure  2.6  Hypotheses  to  be  Tested 
a.  Hypothesis  A 

This  analysis  tests  for  the  effect  of  training 
on  the  "early  treatment  group,"  the  first  set  of  stations  to 
receive  the  training  (see  Figure  2.7). 
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Figure  2.7  Hypothesis  A 

Since  the  early  and  late  treatment  groups  are  non-equivalnet , 
not  randomly  assigned,  the  difference  in  ratings  on  the 
various  measures  could  be  due  to  a  regression  effect.  A 
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comparison  of  simple  difference  scores  may  therefore  be 
misleading.  What  is  needed  is  to  compare  the  results 
actually  attained  with  the  results  that  would  have  been 
attained  under  the  appropriate  null  hypothesis  of  no  treat¬ 
ment  effect  [Ref.  7:  p.  25].  To  account  for  this,  a  method 
of  estimating  the  no-treatment  result  for  the  experimental 
(early  treatment)  group  will  be  used.  The  results  of 
the  late  treatment  group's  second  administration  of  the 
questionnaire  of  interest  will  be  regressed  on  the  results 
of  the  late  treatment  group's  first  administration,  producing 
a  constant  and  an  unstandardized  regression  coefficient. 

These  values  will  be  applied  to  the  actual  results  of  the 
first  administration  for  both  the  early  and  late  treatment 
groups  to  obtain  a  predicted  value  for  the  second  administra¬ 
tion.  These  predicted  values  will  then  be  subtracted  from 
the  actual  values  to  obtain  the  difference  or  residual 
values.  These  residual  values  will  then  be  compared  between 
the  late  and  early  treatment  groups  by  means  of  a  x-test. 

Hypothesis  A  can  be  broken  down  into  analyses 
between  the  late  and  early  treatment  groups  for  SUBQ  Part  III 
Factor  One,  SUBQ  Part  III  Factor  Two,  SUBQ  Part  II  Factor 
One,  SUBQ  Part  II  Factor  Two,  SUBQ  Part  II  Factor  Three, 

SUPQ  Part  II  Factor  One,  SUPQ  Part  II  Factor  Two,  and  SUPQ 
Part  II  Factor  Three.  These  comparisons  and  the  statistical 
techniques  used  are  summarized  in  Table  IV. 
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TABLE  IV 

1 

1 

1 

•  * 

Sub-Hypotheses  foe  H (A) 

i 

i 

i 

vi  iO  * 

*  Uj.  4. 

Hypothesis: 

Nc  charge  between 
'•early''  and 
"late"  groups  for: 

Method  of  1 

Analysis  1 

•  4 

H  <A  1 ) 

Subordinate  perception 
of  Suoerviscr  'Problem 
Solving  Support'. 

- —  .......  1 

STEP  1: 

Regression  of 
"late"  grouo 
admin  2  or. 
admit  1  ; 

H  (R.2) 

Subordinate  Perception 
of  Supervisor  "Passing 
tne  Buck". 

STEP  2: 

Prediction  of 
values  of  admir. 

2  from  values  of 
admin  1  fez  bcih 
"late"  and 

H  (A3) 

• 

Hu  It iole-ch  oice 
Questionnaire 

Score 

• 

H  (A  4 ) 

Subordinate  Perception 
of  Organization 
climate. 

g.oup-=> ; 

H  (A5) 

Subordinate 

Sati  sfactio  n 

Computation  of 

Residuals ; 

H  (A6) 

Subordinat  e 

Commitment 

STEP  3: 

t-test  between 
"early"  croup 
residuals  and 
"late"  group 
residuals. 

• 

H  (A7) 

Supervisory  Perceotion 
of  Organization 
dim  ate. 

H  (A3) 

Su  pervisor 

Sati  sfactio  n 

• 

j  H(AS) 

Supervisor 

Coamitme  nt 
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b.  Hypothesis  B 

This  analysis  tests  for  the  effect  of  training 
on  the  "late  treatment  group,"  the  second  set  of  stations  to 
receive  the  training  (see  Figure  2.8). 


o 
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Figure  2.8  Hypothesis  B 


In  this  situation,  the  regression  effect  is  assumed  to  have 
taken  place  between  the  first  and  second  administration 
[Ref.  8].  Hypothesis  B  can  be  broken  down  into  analyses  of 
the  same  variables  as  Hypothesis  A,  but  comparing  between' 
administration  2  and  administration  3  for  the  "late  treat¬ 
ment  group."  These  comparisons  are  summarized  in  Table  V. 
c.  Hypothesis  C 

This  analysis  tests  for  the  longitudinal  effect 
of  training  for  the  "early  treatment  groups,"  between  the 
first  two  administrations  after  training  (administration  2 
and  administration  3),  as  shown  in  Figure  2.9. 
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T  ABLE  7 

Sub-Hypotfaeses  for  H(B) 


ii  U  11 

H  ypothes  is: 

l.'c  change  between 
administrations  2 
and  3  of  "lata" 
group  for: 

H  (B1) 

Subordinate  perception 
of  Supervisor  'Problem 
Solving  Support' . 

H  (B2) 

Subordinate  Perception 
of  Supervisor  "Passing 
the  Buck". 

H  (E3) 

Multi ple-cho ice 

Quest  icrnair  a 
score 

H  ( B4 ) 

Subordinate  Perception 
o  f  Or ganizat ion 
climate. 

H  (B5) 

Subgr dinate 
satis  faction 

H  (B6) 

S  ub ordinate 

Commitment 

H  "(B7) 

Supervisory  Perception 
of  Or uanioat  ior. 
c lima  re. 

H  (B8) 

S  uoer  visor 

S  atis  fact  ion 

H  (P.9) 

S  UDer visor 

Commi tment 
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Figure  2.9  Hypothesis  C 

This  analysis  also  assumes  that  the  regression  effect  has 
taken  place  between  the  first  and  second  administrations. 
Hypothesis  C  can  be  broken  down  into  analyses  of  the  same 
variables  as  Hypothesis  b;  these  comparisons  are  summarized 
in  Table  VI. 

d.  Hypothesis  D 

This  analysis  tests  for  the  longitudinal  effect 
of  training  for  the  ''early  treatment  groups,"  between  the 
last  two  administrations  after  training  (administration  3 
and  administration  4),  as  shown  in  Figure  2.10. 
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Figure  2.10  Hypothesis  D 
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TABLE  VI 

Sub-Hypotaes  as  for  H(C) 

Null 

Hypothes  is: 

No  chano  a  between 
administrations  2 
and  3  ("early" 
group)  for: 

Method  of 
Analysis 

H  (Cl) 

Subordinate  perception 
of  Suparvisor  'Problem 
Solving  Support*. 

H(C2) 

Subordinate  Per ca Dtio n 
of  S  a  car  visor  "Passing 
the  Buck". 

H  ( C  3) 

M  ulti  ple-cho  ice 

Quest  icnnair e 
score 

T-r?st : 
Comparison 
of  actual 
ratings' 
means 
betv  aer. 

Admin.  2  ar.d 
Admin.  3  for 
the  "early" 
treatment 
groups. 

H  (C4) 

Subordinate  Perception 
of  Organization 
clima  te. 

H  (C5) 

S  ubor dinate 

5  atis  fact  ion 

H  (C6) 

S  ubor  dir.ate 

C  ommi  tmer.t 

H  (C7) 

Supervisory  Perception 
of  Organization 
climate. 

a  ( CQ) 

S  uper  visor 

S  at is  faction 

H  <C9) 

3  up e r visor 

Commitment 
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This  analysis  also  assumes  that  the  regression  effect  has 
already  taken  place.  Hypothesis  D  can  be  broken  down  into 
analyses  of  the  same  variables  as  Hypothesis  C;  these 
comparisons  are  summarized  in  Table  VII. 
e.  Hypothesis  E 

This  analysis  tests  for  the  longitudinal  effect 
of  training  for  the  "late  treatment  groups,"  between  the 
last  two  administrations  after  training  (administration  3 
and  administration  4),  as  shown  in  Figure  2.11. 

E  O  x  0  ©  0 


Figure  2.11  Hypothesis  E 


This  analysis  also  assumes  that  the  regression  effect 
has  already  taken  place.  Hypothesis  E  can  be  broken  down 
into  analyses  of  the  same  variables  as  Hypothesis  D;  these 
comparisons  are  summarized  in  Table  VIII. 
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TABLE  VII 

Sub-Hypotheses  foe  H(D) 


I 


Null 

Hypothec is: 

Me  ccar.gs  between 
administrations  3 
and  4  ("early" 
group)  for: 

H  (D1 ) 

Subordinate  perception 
of  Supervisor  'Problem 
Solving  Support*. 

H  (D2) 

Subordinate  Perception 
of  Suoervisor  "Passing 
the  Buck". 

H  (D3) 

Mult i nie-cho  ice 

Q  uest ienzair  a 

Score 

H  ( D4) 

Subordinate  Perception 
cf  organization 
climate. 

H  (D5) 

Subor  dinars 

Satisfaction 

H  (D6) 

S  ubor dinats 

Comm i tment 

HTT37J - 

S’dpl'f viscfY  Per <3s'pf il> n 
cf  Organization 
clima  re. 

H  (08) 

S  uper  visor 

Satis  fact  ion 

T- test : 

Comparison 

of  actual 

* 

seats  between 
Alain.  3  and 
Admin.  4  for 
the  11  early" 
treatment 
groups  . 


H  ( D9) 


Cconito?  r.t 


TABLE  VIII 

Sub-Hypotheses  for  H(E) 


Mull 

H  Vtjr-  h«a«s 

!lc  chatge  bat  west 
is:  admit  1st  rat  lots  3 

and  u  ("lata" 
group)  for: 

H  (El) 

Subordinate  perception 
of  Supervisor  'Problem 
Solving  Support ' . 

H  (E2) 

Subordinate  Perception 
of  Supervisor  "Passing 
the  Buck". 

H  (E3) 

Multiple-cko  ice 

Q  uest icnnair a 
s  co  r  e 

H  (E4) 

Subordinate  Perception 
of  Organization 
climate. 

H  (E5) 

Subor dinats 

Satisfaction 

H  (E6) 

Subordinate 

Commitment 

H  (£"/) 

Supervisory  Perception 
of  Organization 
c  lima  te. 

H  (E8) 

S  uoer  visor 

Satisfaction 

H  ( E9) 

S  uoer  visor 

Commi tmant 

ilet  no  u  c  i 
A  r.  a  ly  ~is 


I-T;c-  . 

Cc  no  a  r  i  s  o  t 
of  actual 
ratings' 
meats 
bet  wear. 

Admit.  3  ar.d 
Adair..  4  for 
"late" 
tr eatment 
groups . 
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III.  RESULTS 


A.  REGRESSION  RESULTS 

The  study  of  the  effect  of  the  training  on  the  early 
treatment  groups  was  based  on  a  comparison  of  the  residuals 
developed  from  the  regression  analysis  procedure  discussed 
in  chapter  two.  The  regression  analysis  provided  the  values 
for  the  coefficient  "b"  (slope)  and  the  constant  "a"  (inter¬ 
cept)  in  the  regression  equation  for  each  sub-hypothesis 
described  in  chapter  two.  In  addition,  analysis  of  variance 
provides  an  "F-ratio"  which  describes  the  strength  of  any 
linear  relationship  between  administration  one  and  adminis¬ 
tration  two  for  the  sub-hypotheses  of  interest  (for  the  early 
treatment  groups).  Table  IX  provides  a  summary  of  these 
values.  The  null  hypothesis  is  that  the  slope  =  0,  that 
there  is  no  relationship.  A  statistically  significant  rela¬ 
tionship  justifies  using  the  regression  procedure.  Except 
for  "subordinate  perception  of  supervisor  'passing  the  buck'" 
and  "Multiple-Choice  Questionnaire  Score,"  a  signifi¬ 
cant  linear  relationship  is  shown  for  each  sub-hypothesis. 

For  the  non-significant  items,  a  t-test  can  be  used  to 
determine  if  any  differences  exist  between  the  early  and 
late  treatment  groups'  actual  ratings  on  these  items. 


TABLE  IX 

Regression  Analysis  Results 
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B.  HYPOTHESIS  A 


The  first  hypothesis  examined  was  the  null  hypothesis  of 
no  training  effect  on  the  early  treatment  group,  as  deter¬ 
mined  by  a  t-test  between  the  residuals  of  the  ratings  for 
the  early  treatment  group  and  the  late  treatment  group  at 
administration  two.  See  Figure  3.1. 
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L  Q  *  O  O 

Figure  3.1  Hypothesis  A 

The  results  of  these  tests  are  shown  in  Table  X.  The  column 
labeled  "means"  refers  to  the  mean  value  of  the  differences 
between  the  actual  and  predicted  scores  (difference,  or 
residual,  equals  the  actual  score  minus  its  predicted  score). 
This  difference  is  negative  if  the  actual  score  is  less  than 
the  predicted  score.  When  this  happens  for  the  group  that 
received  the  training,  it  indicates  that  the  training  has 
caused  a  reduction  in  the  score  used  in  the  test  of  the 
sub-hypothesis.  If  the  difference  is  positive,  it  indicates 
that  the  training  has  caused  an  increase  in  the  score.  For 
those  items  showing  a  significant  linear  relationship  for 
the  late  treatment  group  between  administration  one  and 


TABLE  X 

Residuals  T-Test  Results 


Null  Hypothesis:  He  a  ns: 

Nc  change  between  Eariv  T- 

"early’'  and  - 1-  Value 

"late"  gronos  for:  Lars 

d.i. 

2- tail 
Pr  cb. 

H  (A  1 ) 

SuDordinate  per¬ 
ception  of  Surer-  -0.2452 
vi'ser  'Problem  -1.52 

Solving  support'  0.0030 

92 

.110 

H  (A  2) 

Subordinate  Per¬ 
ception  of  Super-  -0.0562 
visor  "Passing  -0.29 

the  Buck:"  0.0030 

92 

.769 

H  (A3) 

Multi  pi a- choice  0.1949 

Questionnaire  2.73 

score  0.0000 

35 

.010* 

H  (A4) 

Subordinate  Per¬ 
ception  of  -0.3527 

Organizational  -2.32 

Climate  0.0000 

91 

.  022* 

H  (A5) 

Subordinate  -0.3381 

Satisfaction  -2.27 

0.0000 

91 

.  025* 

H  ( A6 ) 

Subordinate  -0.322S 

commitment  -1.88 

0.0000 

68.45 

.  064* 

H  (A7) 

Supervisor  Per¬ 
ception  of  0.1102 

organizat  icnal  0.44 

Climate  0.0300 

35 

.666 

H  (A8) 

Super  visor  0.2311 

Satisfaction  1.08 

0.0000 

35 

.  239 

H  (A9 ) 

Supervisor  -0.224  8 

Commitment  -3.84 

0.0330 

35.90 

.407 

Nets: 


"a.f."  refers  to  degrees  of  freedom.  T-Value 
refers  to  the  student  t-statistic. 

*  identifies  the  most  significant  items. 


administration  two,  as  discussed  in  the  previous  section,  a 
comparison  of  the  difference,  or  residual,  means  between  the 
early  and  late  treatment  groups  provides  a  measure  of  the 
significance  of  any  changes  noted.  Table  X  snows  the 
results  of  these  comparisons.  For  those  items  not  showing  a 
significant  linear  relationship  for  the  late  treatment  group 
between  administration  one  and  administration  two,  a  compar¬ 
ison  of  the  actual  scores  (for  example,  using  a  t-test  )  is 
appropriate.  Table  XI  provides  the  t-test  results  for  these 
items,  as  well  as  t-test  results  for  the  other  sub-hypotheses 
for  comparison  with  the  regression  results. 

As  shown  in  Table  X,  sub-hypotheses  3,  4,  5  and  6  indi¬ 
cate  significance  at  least  at  the  .065  level.  Multiple-Choice 
Questionnaire  Scores  are  above  the  predicted  scores  for  the 
early  treatment  group,  indicating  that  training  had  a  posi¬ 
tive  impact  on  supervisors'  knowledge  of  the  problem  solving 
process.  (As  would  be  expected,  because  the  linear  rela¬ 
tionship  between  administration  one  and  administration  two 
for  the  late  treatment  groups'  Multiple-Choice  Questionnaire 
Scores  was  not  significant,  the  t-test  on  the  actual  scores 
provided  similar  results.  See  Table  XI.)  Subordinate 
perception  of  organizational  climate,  satisfaction  and 
commitment  all  show  a  significant  decrease  for  the  early 
treatment  group  (p  >  .065),  indicating  that  the  training  had 
a  negative  impact  on  these  ratings. 
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T&6LS  XI 

Ac  fa ai-Sccr e  T-test  Results 


Nui 
:;o 
"ea 
"  la 
adn 

1  Hvoothesis: 
change  between 
r  iy"  and 
te"  arouos  fcr 

Means: 

T- 

Early  Value 

d.f.  2-tail 
?  r  c  b . 

H  (M) 

Subordinate  Der- 
ceotion  of  Sudst- 
vi 3 o  r  *  ?r  ofclea 
Solving  Support* 

u .5030 

-  1.53 

4.7332 

92  .113 

H  (A2) 

Subordinate  Per- 
ceotion  of  Super¬ 
visor  "Passing 
the  Buck" 

2.6333 

-0.23 

2. 7324 

92  .822 

H  (A3) 

Kult iple- choice 

Questionnaire 

score 

0.5920 

2.72 

0. 3999 

35  .0  10* 

H(AU) 

Subordinate  Per¬ 
ception  of 
ora  a  n.ir  at  icr.al 
Climate 

tt. 0373 

-2.47 

4. 47 47 

92  .015* 

H  (A5) 

Subor  dinat e 
satisfaction 

4. 3445 

-3.26 

4.9125 

39.4  0  .002* 

a  (A6) 

Subordinate 

Commitment 

3.5435 

-2.41 

3.9653 

30.19  .018* 

H  (A7) 

Supervisor  Per¬ 
ception  of 
organ  izat  icnal 
Cliaa  te 

4. 16  4  2 

0.26 

4.0827 

35  .797 

H  (A8) 

Supervise  r 

Sat  is  fact  ion 

4.8776 

0.81 

4.6526 

27.7  1  .  426 

H  (A9) 

Supervisor 

Commitment 

3.7222 

-2.  39 

4.  543  9 

35  .022* 

Note: 


" d. f .  "  refers  to  d?a:ees  of  freedom.  T-Value 
refers  to  the  student  t-statistic. 

*  identifies  the  mos*  significant  itens. 
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C.  HYPOTHESIS  B 


The  second  hypothesis  examined  is  the  null  hypothesis  of 
no  treatment  effect  on  the  late  treatment  group,  as  deter¬ 
mined  by  a  t-test  on  the  ratings  between  administration  two 
(immediately  before  the  training)  and  administration  three 
(immediately  after  the  training).  See  Figure  3.2. 

■  ©  ■  ©  ©  © 


l  ©  ©  _ (5)  © 

Figure  3.2  Hypothesis  B 

The  results  of  these  tests  are  shown  in  Table  XII.  In  this 
and  the  remaining  tables,  "means"  refers  to  the  means  of  the 
actual  scores  or  ratings.  Most  of  the  means  show  the  appro¬ 
priate  trends,  but  none  except  Multiple-Choice  Questionnaire 
Score  are  significant  below  the  .124  level.  Multiple-Choice 
Questionnaire  Score  is  the  most  significant  (p  >  .087). 

D.  HYPOTHESIS  C 

The  third  hypothesis  examined  is  the  null  hypothesis  of 


no  longitudinal  change  in  the  ratings  for  the  early  treat¬ 
ment  group  for  the  two  administrations  immediately  following 
training  (administrations  two  and  three).  See  Figure  3.3. 


» 


Table  XII 

i 

j 

i 

i 

T- 

-Test  Results  for 

Sub-Hypotheses  of  H(3) 

Null  Hypothesis: 

No  change  between 
aumir.istr ation  2 
and  ado in istr a- 
tier.  3  for  the 
"late"  groups 

Means: 

Admin  T- 

2  Value 

Ad  min 

3 

r  C 

?r  cb. 

» 

H  (31) 

Subordinate  oer- 
cepticn  of  Super 
visor  'Problem 
Solving  support* 

4.7491 

-1.55 

5.0013 

1  02 

.  124 

! 

i 

> 

H  (B2) 

Subordinate  Per¬ 
ception  of  Super 
visor  "Passioa 
the  Buck" 

2.7811 

0.90 

2.5942 

1  02 

.  36  9 

, 

i 

i 

H  (B3 ) 

Multiole-choice 

Questionnaire 

score 

39.9926 

-1.76 

52.7415 

36 

.  087  * 

1 

i 

i 

» 

H  (B4) 

Subordinate  Per- 
caoticn  of 
Organizational 
Climate 

4.4533 

0.  1Q 

4.4233 

1  32 

.  846 

i 

i 

i 
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H(B5) 

Subor dmate 

Satis  fact  ion 

4.8731 

-0.56 

4.9634 

96.95 

.  577 

H  (B5 ) 

Subor dina  te 
Commitment 

3. 9551 

3 .34 

3. 9487 

92.  35 

.  963 
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H  (B 7 ) 

Supervisor  Per- 
ceotion  of 

Croat.  izat  icral 
Climate 

4.0327 

-0.56 

4.2770 

36 

.  579 

i 

i 

i 

H  (38) 

Sup  a  r vise  r 

Satis  fact  ion 

4.6526 

0.3 

4.6523 

35 

1.73 
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H  (39) 

SUDer  visor 
Commitment 
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4 . 456  1 

36 

.792 
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refers  to  the  student  t-statiscic 
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Figure  3.3  Hypothesis  C 

This  analysis  determined  whether  the  after-training  scores 
either  declined  or  increased  over  time,  and  the  significance 
of  any  differences.  The  results  of  this  analysis  are  shown 
in  Table  XIII.  The  most  significant  difference  is  for 
sub-hypothesis  six,  subordinate  commitment,  which  has 
increased  from  administration  two  to  administration  three 
(p  >  .172). 

E.  HYPOTHESIS  D 

The  fourth  hypothesis  examined  is  the  null  hypothesis  of 
no  longitudinal  change  in  the  after-training  ratings  for  the 
early  treatment  group  for  administrations  three  and  four. 

See  Figure  3.4. 

'  ©  <  ©  eircb 
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Figure  3.4  Hypothesis  D 
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This  analysis  determined  whether  the  after-training  scores 
either  declined  or  increased  over  time,  and  the  significance 
of  any  differences.  The  results  of  this  analysis  are  shown 
in  Table  XIV.  The  most  significant  result  (p  >  .211)  is  for 
sub-hypothesis  nine,  supervisor  commitment,  which  increased 
from  administration  three  to  administration  four. 

F.  HYPOTHESIS  E 

The  fifth  hypothesis  examined  is  the  null  hypothesis  of 
no  longitudinal  change  in  the  ratings  for  the  late  treatment 
group  between  the  last  two  administrations  following  the 
training  (administrations  three  and  four).  See  Figure  3.5. 

•  ©  «  ©  ©  © 

1  ©  ©  * 

Figure  3.5  Hypothesis  E 

This  analysis  used  the  same  methodology  as  used  for 
Hypothesis  D.  The  results  are  shown  in  Table  XV.  The  most 
significant  result  is  for  sub-hypothesis  six,  subordinate 
commitment  (p  a  .113),  which  has  increased  from  administra¬ 
tion  three  to  administration  four. 


55 


T”ble  XIV 

T-Test  Results  for  Sub-Hypotheses  of  H(D) 


Null 
No  c 
admi 
3  an 
"  car 

Hypo  tries  is: 

:hange  between 
nistrations 
a  4  for  the 
ly"  groups 

Means: 

Admin 

3 

p  _ 

V  alue 

d.f.  2-tail 
Prob. 

4 

H  (D  1) 

Subordinate  ocr- 
ceotion  of  Super¬ 
visor  'Problem 
Solving  Support' 

4.5693 

4.5540 

0.08 

84.26  .937 

H(D2) 

Subordinate  Per¬ 
cent  ior.  of  Super¬ 
visor  "Passina 
the  Buck" 

2.7117 

2.4676 

1.09 

95  .277 

H(D3) 

Multiple- choice 

Questionnaire 

score 

58.8235 

55.4701 

0.51 

33  .613 

H  (D4) 

Subordinate  Per¬ 
ception  of 
Organizat  ional 
Climate 

3.9099 

3.9298 

0.53 

95  .601 

H  (D5) 

Subor  din  ate 

Satis  fact icn 

4 . 4950 

4.551 1 

-.28 

95  .783 

H  (D6) 

Subordinate 

Commitment 

3.7200 

3.7943 

-.34 

95  .737 

H(D7) 

SuDepvisor  Per¬ 
ception  of 
Organizational 
climate 

3.9846 

4 . 1 07  £ 

-.38 

25.9  1  .  709 

H  (D8) 

SuDervisor 

Sat  is  fact  icn 

4.6557 

4.73S9 

-.33 

31  .742 

H  <09  > 

Super  viso r 
Commitment 

3. 7778 

4.314  8 

1 .  28 

J  1  . 2  i  1* 

Note: 


"d.f."  refers  to  degrees  of  freedom.  T-Value 
refers  to  the  student  r.-st a  trstic. 

*  identifies  the  most  signif leant  it 
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Table  XV 


T-Test  Results  for  Sub-Hypotheses  o f  H(E) 


Nall  Hypothesis: 

No  charge  between 
administrations 

3  and  4  for  the 
« late"  grouos 

Means: 

Admin 

3 

4 

T  - 

Valu* 

d.f. 

2- tail 
Prcb. 

H  (Si) 

Subordinate  Der- 
ceotior.  of  Siio=»r 
visor  «Profclem 
Solving  Support1 

5. 0310 

4.  814  2 

1  .  16 

101 

.  24  8 

H  (E2) 

Subordinate  Per¬ 
ception  of  Super 
visor  "Passinq 
the  Buck" 

2.5942 

2.5140 

0.37 

101 

.714 

H  (E3 ) 

tluit  iple-  choice 
Quest  lonnaire 
score 

52.7415 

49.9325 

0.38 

36 

.708 

H(E4) 

Subordinate  Per- 
csotion  of 
Organizational 
Climate 

4.4203 

4.2259 

1.11 

101 

.  270 

H  (E5) 

Subor  lir.ate 

Satis  fact  icn 

4.9654 

4 . 8627 

0.68 

101 

.496 

H  (E6) 

Subor dina te 
Commitment 

з.  9487 

и. 2222 

-1 .  60 

101 

.113* 

H  (E7) 

Supervisor  Per¬ 
ception  of 

Organ izat ional 
climate 

4.  2770 

4.4135 

3b 

36 

.718 

H  (E8 ) 

Sup  er viso r 

Satis  fact  ion 

4.6526 

4.9053 

-.73 

36 

.  471 

H  (E9) 

Supervisor 

Commi tmsnt 

4.4551 

4.6667 

-.71 

36 

.484 

Note : 

” d « f . "  refers  to  degrees  of 
refers  to  the  stu dent ~t-st a 
*  identifies  the  most  sign! 

f  reed 
t is  tic 
f leant 

CD,  T 

items 

-Value 

• 

IV.  DISCUSSION 


A.  INTRODUCTION 

As  mentioned  in  chapter  two,  the  first  portion  of  the 
research  design  developed  for  this  project  is  described  by 
Campbell's  and  Stanley's  Design  10  [Ref.  3:  pp.  46-50],  a 
quasi-experimental  non-equivalent  control  group  design, 
which  they  state  is  one  of  the  most  widespread  experimental 
designs  in  education  research.  The  more  the  experimental 
and  control  groups  are  similar  in  their  recruitment  and  the 
more  this  similarity  is  confirmed  by  scores  on  a  pre- 
measure,  the  more  effective  this  design  is  in  controlling 
for  the  main  effects  of  history,  maturation,  testing  and 
instrumentation.  One  area  of  concern  in  this  design  is  that 
of  intrasession  history.  Since  all  of  the  subjects  in  each 
of  the  experimental  groups  are  measured  in  two  separate 
sessions,  and  the  same  for  the  control  groups,  the  irrele¬ 
vant  unique  events  in  any  of  these  sessions  become  rival 
hypotheses  for  explaining  any  pre-measure/post-measure 
differences  for  the  two  early  treatment  groups,  the  two  late 
treatment  groups  or  between  the  combined  "early"  groups  and 
the  combined  "late"  groups.  Another  major  concern  affecting 
internal  validity  is  that  of  interaction  effects  of  selec¬ 
tion  and  such  extraneous  factors  as  history,  maturation  and 
testing.  In  general,  these  interactions  are  unlikely,  but 
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must  be  considered  in  the  analysis.  Regression  can  provide 
another  source  of  internal  validity  problems  in  this  design  , 
especially  if  a  matching  procedure  is  used  that  results  in 
substantially  different  group  means. 

B.  INSTRUMENTATION 

Four  sets  of  questionnaires  were  administered  during 
this  training  program  to  the  supervisors  or  the  subordi¬ 
nates,  as  appropriate,  each  attempting  to  measure  some 
portion  of  the  training  effectiveness  criteria  (learning, 
behavior,  reaction  and  results)  discussed  in  Chapter  Two. 
Since  the  main  objective  of  the  training  program  was  to 
change  supervisors'  behavior  to  be  more  effective  in  dealing 
with  problem-solving  situations,  the  measures  of  the  subor¬ 
dinates'  perceptions  of  supervisors'  behavior  in  using 
problem-solving  skills  is  of  primary  interest.  The  measure¬ 
ment  was  done  with  the  Subordinate  Organization  Survey  (SUBQ) 
Part  III.  To  simplify  the  analysis,  this  data  was  subjected 
to  factor  analysis  and  two  factors  were  identified.  One  of 
the  problems  with  aggregating  data  in  this  manner  is  the 
inability  to  diagnose  specific  strengths  or  weaknesses  of 
the  training  program.  Data  aggregation  is  more  useful, 
however,  to  explain  why  the  overall  results  have  occurred. 

The  primary  purpose  of  this  thesis  is  to  determine  the 
overall  effectiveness  of  the  training  program,  so  using  the 
aggregated  data  appears  to  be  appropriate.  The  factors 
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identified  do  seem  to  make  sense  and  to  be  combining  vari¬ 
ables  measuring  similar  properties.  The  factor  analysis  was 
based  on  data  from  the  first  administration  for  the  late 
treatment  group,  and  the  same  factors  were  used  for  all 
administrations  for  each  group.  The  other  data  sets  were 
used  to  assess  the  criteria  of  learning,  reaction  and 
results  in  order  to  explain  the  behavior  ratings.  Part  II 
of  the  Subordinate  Organization  Survey  and  Supervisory 
Organization  Survey  measure  some  of  the  results  criteria, 
such  as  organizational  climate,  satisfaction  and  commitment. 
The  variables  associated  with  these  items  were  subject  to 
factor  analysis,  with  the  result  that  one  factor  for  each 
category  was  found  to  be  appropriate.  The  disadvantage  of 
aggregating  the  data,  as  noted  earlier,  is  the  inability  to 
pinpoint  a  specific  weakness  for  diagnostic  purposes.  The 
Multiple-Choice  Questionnaire  (MCQ)  measured  supervisors' 
knowledge  of  the  problem-solving  process  and  was  scored  on  a 
right /wrong  basis  for  each  question.  This  researcher 
completed  the  questionnaire  after  reading  the  descriptive 
material  for  the  training  program,  including  the  trainer's 
guide,  and  selected  all  the  answers  subsequently  identified 
as  correct  by  the  company  which  developed  the  training 
package,  providing  a  measure  of  face  validity  for  the  ques¬ 
tionnaire.  By  measuring  the  supervisors'  learning  (change 
in  knowledge)  of  the  problem-solving  process  after  training, 
one  source  of  behavior  differences  can  be  analyzed.  The 
Supervisory  Evaluation  of  Training  Questionnaire  (SETQ) 
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provides  a  measure  of  supervisor  reaction  to  the  training  as 
well  as  a  measure  of  intrinsic  motivation  and  extrinsic 
support.  Since  this  questionnaire  was  given  only  once 
(immediately  after  training)  for  each  group,  the  only 
comparisons  possible  are  between  the  early  treatment  group 
at  administration  two  and  the  late  treatment  group  at  admin¬ 
istration  three.  These  comparisons  could  be  affected  by  the 
fact  that  the  late  treatment  group  completed  the  survey  one 
month  later  than  the  early  treatment  group. 

C .  SAMPLE 

The  data  comparisons  are  based  on  relatively  small 
sample  sizes,  which  affect  the  general izability  of  the 
results  to  the  population  of  all  Coast  Guard  supervisors. 

In  addition,  the  results  may  be  contaminated  due  to  the  fact 
that  subordinates  usually  rated  more  than  one  supervisor 
and  that  each  supervisor  was  usually  rated  by  more  than 
one  subordinate.  This  could,  however,  serve  to  increase 
the  reliability  of  the  overall  ratings  because  of  the 
multiple  measurements  for  each  supervisor.  The  area  of 
greatest  concern  about  contamination  is  the  fact  that  some 
of  the  supervisors  who  received  the  training  also  completed 
surveys  as  subordinates.  This  could  tend  to  bias  the 
results,  although  the  direction  of  bias  is  not  predictable. 
The  supervisors  who  are  also  subordinates  and  were  exposed 
to  the  training  could  be  either  more  critical  after  training 
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or  more  perceptive  of  the  changes  in  their  supervisors' 
behavior.  The  validity  of  this  means  of  measuring  supervi¬ 
sors'  behavior  is  somewhat  suspect.  It  is,  however,  the 
only  measure  of  behavior  available  in  this  analysis. 

D.  REGRESSION  PROCEDURE 

The  regression  analysis  described  in  Chapter  Three, 

Table  IX,  indicates  a  linear  significant  relationship 
(p  >  .0060)  between  administration  one  and  administration 
two  for  the  late  treatment  group  with  respect  to  all  sub¬ 
hypotheses  of  interest  except  sub-hypothesis  two  (subordi¬ 
nate  perception  of  supervisors  "passing  the  buck"  with  regard 
to  problem  solving,  p  >  .1328)  and  sub-hypothesis  three 
(multiple-choice  questionnaire  score,  p  >  .8813).  For  these 
sub-hypotheses,  application  of  the  regression  procedure  would 
not  be  significantly  different  from  measuring  directly  the 
differences  in  the  actual  scores  between  early  and  late 
treatment  groups.  The  regression  procedure  used  assumes 
that  the  initial  means  and  standard  deviations  of  the  early 
and  late  treatment  groups  are  the  same.  If  this  is  not  the 
case,  results  would  be  erroneous.  A  comparison  of  the 
actual  score  means  for  each  sub-hypothesis  found  that  the 
means  and  standard  deviations  did  not  differ  significantly 
(at  p  >  .05).  Subordinate  satisfaction  and  supervisor 
commitment  showed  the  most  significant  differences  p  >  .134 
and  p  >  .100,  respectively)  between  the  means,  and 
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subordinate  satisfaction  the  most  significant  difference 
(p  >  .043)  between  the  standard  deviations.  This  will 
be  considered  in  the  discussion  of  the  results  of  the 
comparisons  of  subordinates'  satisfaction  and  of  supervi¬ 
sors'  commitment  ratings. 

E.  RESULTS 

1 .  Behavior  Criteria:  Early  Treatment  Groups 

Hypothesis  A  examined  the  relationships  between  the 
early  and  late  treatment  groups  after  applying  the  regres¬ 
sion  procedure  in  the  case  of  each  of  the  sub-hypotheses  of 
interest.  It  was  found  that  subordinate  perception  of 
supervisors'  behavior  was  not  significantly  different  after 
training  for  either  of  the  two  factors  examined.  The  most 
significant  factor,  "problem  solving  support"  (p  >  .110), 

I 

showed  a  decrease  in  the  mean  score,  indicating  that  immedi¬ 
ately  after  completion  of  the  training  subordinates  felt 
that  the  supervisors'  behavior  was  less  effectively  applied 
to  problem  solving  than  the  behavior  of  the  untrained  super¬ 
visors.  This  result  could  be  partially  due  to  the  subordi¬ 
nates  having  higher  expectations  of  their  supervisors  after 
completing  the  4-week  training  package,  since  they  were 
aware  that  the  supervisors  were  being  trained  and  in  fact 
some  of  the  subordinates  were  also  considered  to  be  supervi¬ 
sors  and  received  the  training.  The  training  could  have 
made  them  more  aware  of  the  problem  solving  process  and  of 
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any  differences  between  the  ideal  and  the  actual  behaviors. 
This  hypothesis  can  be  viewed  as  a  "negative  Hawthorne 
effect,"  affecting  the  external  validity  of  the  results, 
as  well  as  resulting  in  instrumental  decay  [Ref.  3]  (the 
instrument  no  longer  is  measuring  behavior  with  the  original 
criteria),  one  of  the  conditions  which  affects  internal 
validity.  Although  the  results  obtained  indicate  that  the 
training  had  no  significant  impact  on  subordinate 
perception  of  supervisors'  behavior,  there  are  enough  rival 
hypotheses  to  investigate  as  possible  explanations  of  these 
results  that  a  firm  conclusion  that  the  training  is  not 
effective  is  not  possible  without  further  study.  For 
example,  the  validity  of  using  the  Subordinate  Organization 
Survey  Questionnaire  instrument  as  the  measure  of  supervisor 
behavior  is  suspeot  because  of  the  factors  mentioned  above. 
In  addition,  there  could  still  be  differences  in  long-term 
behavior  ratings,  which  were  examined  in  Hypotheses  C  and 
D.  In  testing  each  of  these  hypotheses,  however,  there  was 
no  significant  difference  in  supervisors'  behavior. 

Another  possible  explanation  is  that  the  impact  of 
training  differed  between  the  early  treatment  groups. 

Further  data  analysis  was  done  comparing  the  regression- 
adjusted  means  at  administration  two  for  groups  E3  and  E5 
(see  Figure  2.1)  that  showed  a  difference  for  the  second 
factor  ("passing  the  buck,"  p  >  0.010),  with  the  mean  for 
group  E3  decreasing  (as  desired  for  this  factor)  but 
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increasing  for  group  E5 .  There  was  no  difference  for  the 
first  factor.  A  t-test  comparing  the  means  of  the  actual 
ratings  for  group  E3  between  administration  one  and  adminis¬ 
tration  two  showed  a  significant  decrease  (p  >  0.006)  for 
this  second  factor  (not  adjusted  using  regression  proce¬ 
dure).  Based  on  a  comparison  of  the  residuals  t-tests  and 
the  actual-ratings  t-tests  of  Hypothesis  A  (Tables  XI  and 
XII),  it  is  believed  that  this  strongly  significant  result 
would  remain  significant  after  the  regression-procedure 
adjustment.  There  is  no  significant  longitudinal  change  for 
group  E3  on  this  second  factor  for  the  last  two  administra¬ 
tions,  indicating  that  the  training  may  have  a  lasting 
impact  on  this  factor  for  group  E3.  In  terms  of  behavior, 
this  result  indicates  that  the  training  was  effective  for 
one  group  on  one  factor,  but  overall  made  no  difference. 

This  information  is  useful  for  diagnostic  purposes,  but 
further  discussion  is  beyond  the  score  of  this  thesis. 

Another  possible  explanation  for  the  lack  of  training 
impact  on  the  early  treatment  group  compared  with  the 
late  treatment  group  at  administration  two  could  be  related 
to  demographic  differences.  Table  XVI  shows  the  mode  for 
each  of  the  categories  of  subordinate  demographic  data 
collected  on  the  Subordinate  Organization  Survey  Question¬ 
naire  (SUBQ,  Part  I)  and  for  the  supervisors,  collected 
on  the  Supervisory  Organization  Survey  Questionnaire  ( SUPQ , 
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Part  I).  A  t-test  comparing  the  means  of  the  early  and  l  a.te 
treatment  groups  for  each  of  these  categories  showed  no 
significant  differences. 


TABLE  XVI 
Demographic  Data 


Mod ^  for 

Subo  rdinat es 

;i  3^3 

Su perv 

for 

isors 

"Early” 
gr oud  s 

"Lats" 

G  rcu? s 

"Early” 

Groups 

"Late" 

Groups 

Age 

20-24 

20-24 

20-24 

20-24/ 

25-29* 

Sex  (percent  male) 

80.4  X 

77.5  5 

IgjQQjl 

100S 

MM 

2/4* 

111 

5-7 

Years  in 

Current  Assignment 

<1/2* 

<1/2* 

<i 

2 

Years  worked  for 
Current  Supervisor 

1-2 

1-2 

1-2 

1-2 

*  NOTE:  "x/x”  indicates  a  bi-modal  distribution 
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2 .  Behavior  Criteria:  Late  Treatment  Groups 

Hypothesis  B  examined  the  relationships  between  the 
early  and  late  treatment  groups'  actual  score  means  for  the 
sub-hypotheses  of  interest.  As  shown  in  Chapter  3,  Table 
XII,  subordinates'  perception  of  supervisors'  behavior  did 
not  change  significantly  after  training  for  either  of  the 
two  factors  examined.  This  result  indicates  that  supervi¬ 
sors'  behavior  was  net  affected  by  the  training  program.  As 


discussed  in  the  preceding  section,  however,  there  are  many 
rival  hypotheses  to  explain  why  training  did  not  appear  to 
have  an  impact  on  behavior.  These  include  rising  expecta¬ 
tions  from  the  subordinates  and  their  changing  understanding 
of  what  is  the  ideal  standard  of  behavior  compared  with 
reality  ("instrumental  decay”).  The  same  possibilities  for 
contamination  exist  for  these  late  treatment  groups  as  for 
the  early  treatment  groups  as  discussed  in  the  preceding 
sect  ion  . 

Tht  study  of  the  longitudinal  effects  of  training  on 
supervisor  behavior  were  examined  in  Hypothesis  E,  with  no 
significant  difference  detected  for  the  combined  late  treat¬ 
ment  groups.  Further  data  analysis  was  done  to  examine  the 
rival  hypothesis  of  differential  impact  of  training  on  the 
late  treatment  groups.  It  was  found  that  group  L6  showed  a 
significant  increase  (p  >  ,055)  in  the  ratings  for  factor 
one,  "problem  solving  support."  No  significant  differences 
were  noted  for  group  L4  on  either  factor  or  for  L6  on  the 
second  factor.  No  significant  longitudinal  difference  was 
noted  for  group  L6  on  factor  one  between  administrations 
three  and  four,  indicating  a  possible  long  term  effect  for 
this  factor.  As  with  the  early  treatment  groups,  this 
result  indicates  that  the  training  was  effective  for  one 
group  on  one  factor,  but  overall  made  no  difference  on 
subordinate  perception  of  supervisors'  behavior.  Further 
study  to  determine  why  there  is  a  differential  effect  would 
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be  useful  for  diagnostic  purposes,  but  is  beyond  the  scope  of 
this  thesis. 

3 .  Learning  Criteria 

If  the  training  made  no  difference  on  supervisor 
behavior,  a  logical  first  step  toward  explaining  why  is  to 
examine  learning,  the  increase  in  knowledge  as  measured  by 
the  Multiple-Choice  Questionnaire.  Sub-hypothesis  H(A3) 
examined  the  difference  in  knowledge  after  training  for  the 
early  treatment  group  and  sub-hypothesis  H(B3)  examined  the 
differences  for  the  late  treatment  groups.  As  shown  in 
Ch.-pter  3,  Table  X,  there  was  a  significant  increase  for  the 
early  treatment  group  (p  >  0.010).  For  the  late  treatment 
groups,  Table  XII  shows  an  increase  significant  at  only  the 
0.087  level.  The  mean  scores,  however,  appeared  to  be 
fairly  low.  The  mean  score  for  the'  early  treatment  group 
was  only  59%  (9  of  15  correct)  and  for  the  late  treatment 
group  was  53%  (8  of  15  correct)  after  training.  Group  E3 
showed  a  significantly  higher  mean  score  (p  >  .100)  than 
group  E5  (67%  vs.  47%  correct)  after  training.  For  the  late 
treatment  groups,  C6  showed  a  significant  increase  in  knowl¬ 
edge  (at  the  .029  level)  to  70%  correct,  while  L4  showed  no 
significant  increase  and  a  mean  score  of  37%  after  training. 
These  results  follow  the  results  in  the  previous  sections, 
indicating  that  the  training  was  effective  for  groups  E3  and 
L6 ,  but  overall  was  ineffective.  Although  when  this  number 
of  hypotheses  are  tested  some  are  bound  to  be  significant  by 


chance,  it  is  felt  that  the  consistency  of  this  particular 
finding  (both  behavior  and  knowledge  were  found  to  be 
significantly  higher  for  groups  E3  and  L6 )  gives  it  more 
credibility  than  it  might  otherwise  merit  and  should  be 
considered  tor  diagnostic  purposes. 

4 .  Results  Criteria 

Results  criteria  in  terms  of  subordinates'  and 
supervisors'  views  of  organizational  climate,  satisfaction 
and  commitment  to  the  Coast  Guard  were  measured  by  Part  II 
of  both  the  Subordinate  Organization  Survey  and  the 
Supervisory  Organization  Survey  questionnaires.  For  the 
early  treatment  groups,  sub-hypotheses  H(A4),  H(A5)  and 
H(A6)  examine  the  results  criteria  for  subordinates,  and 
sub-hypotheses  H(A7),  H(A8)  and  H(A9)  examine  these  criteria 
for  the  supervisors.  As  shown  in  Table  X,  there  is  no 
significant  change  for  the  supervisdrs  on  these  criteria, 
but  for  the  subordinates  there  is  a  significant  decrease 
immediately  after  training  for  all  three  categories. 
Hypotheses  C  and  D  examined  the  longitudinal  effects  for 
these  sub-hypotheses.  At  administration  three,  as  shown  in 
Table  XIII,  subordinate  commitment  shows  the  most  signifi¬ 
cant  change  (p  >  .172),  moving  slightly  upward.  At  adminis¬ 
tration  four,  as  shown  in  Table  XIV,  supervisor  commitment 
shows  the  most  significant  change  (p  >  .211),  also  moving 
slightly  upward.  In  summary,  for  the  early  treatment 
groups,  there  appears  to  be  no  change  for  the  supervisors 
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and  a  negative  change  for  the  subordinates  in  terms  of  the 
results  criteria. 

For  the  late  treatment  groups,  sub-hypotheses  H(B4), 
H(B5)  and  H(B6)  examine  the  results  criteria  for  subordi¬ 
nates  and  H(B7),  H(B8)  and  H(B9)  examine  the  criteria  for 
the  supervisors.  As  shown  in  Table  XII,  there  is  no  signif¬ 
icant  change  in  any  of  these  cases  immediately  following 
training.  Hypothesis  E  examines  the  longitudinal  effects 
for  these  sub-hypotheses.  As  shown  in  Table  XV,  subordinate 
commitment  shows  a  slight  increase  (p  >  .113)  for  adminis¬ 
tration  four. 

These  results  indicate  a  difference  in  the  reception 
by  the  subordinates  between  the  early  and  late  treatment 
groups.  Perhaps  the  implementation  of  practice  of  the 
problem  solving  skills  was  handled  differently  between  the 
early  and  late  treatment  groups.  Further  study  of  this 
issue,  as  well  as  investigation  of  possible  differential 
effects  between  the  "early"  groups  and  between  the  "late" 
groups,  would  be  useful  for  diagnostic  purposes.  Within  the 
scope  of  this  research,  it  appears  that  training  has  not 
had  a  positive  impact  on  these  results  criteria,  and  for  the 
early  treatment  group,  the  impact  on  these  criteria  has  been 
negative . 

F.  CONCLUSIONS  AND  RECOMMENDATIONS 

The  overall  results  of  this  analysis  indicate  that  the 
training  package  was  not  effective  in  changing  the 
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supervisors 1  behavior;  it  had  moderate  success  in  teaching 
a  knowledge  of  the  problem  solving  process;  it  had  a  negative 
impact  on  subordinate  perception  of  organizational  climate, 
satisfaction  and  commitment  to  the  Coast  Guard  for  the  early 
treatment  group  and  no  significant  impact  on  these  criteria 
for  the  late  treatment  group.  Figure  4.1  through  Figure 
4.9  provide  a  summary  of  the  results  of  the  study  of  the 
sub-hypotheses  considered  in  this  analysis.  A  "+"  or 
indicates  the  direction  of  change.  Without  further 
study  investigating  the  reasons  why  behavior  change  did  not 
occur  for  all  treatment  groups,  the  results  of  this  study 
suggest  that  the  U.S.  Coast  Guard  implementation  of  this 
training  package  should  not  proceed. 
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Figure  4.1  Problem  Solving  Support 


*(D) 


769) 


p  5  .320)  p  >  .601) 


Figure  4.4  Subordinate  Perception  of  Organizational  Climate 
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Figure  4.5  Subordinate  Satisfaction 
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Figure  4.6  Subordinate  Commitment 


APPENDIX  A 


QUESTIONNAIRE  CODING 


A.  INTRODUCTION 

This  appendix  relates  the  four  survey  instruments  used 
to  study  the  effectiveness  of  the  "Problem  Solving  Skills 
for  Managers"  training  package  to  the  variable  names  and 
value  labels  assigned  to  the  SPSS  System  File  developed  to 
facilitate  the  analysis.  Four  separate  files  were 
established,  one  for  each  survey  instrument.  They  are: 

SUBQ  (Subordinate  Organization  Survey);  SUPQ  (Supervisory 
Organization  Survey);  MCQ  (Multiple  Choice  Questionnaire); 
and  SETQ  (Supervisory  Evaluation  of  Training  Questionnaire). 

The  questionnaires  were  administered  according  to  the 
following  schedule: 


Station 

E300 

A1 

X 

A2 

A3 

A4 

Station 

E500 

A1 

X 

A2 

A3 

A4 

Stat ion 

L400 

A1 

A2 

X 

A3 

A4 

Station 

L600 

A1 

A2 

X 

A3 

A4 

A1  refers  to  the  first  administration,  A2  to  the  second 
administration  and  so  on.  SUBQ,  SUPQ,  and  MCQ  were  filled 
out  at  all  four  administrations.  SETQ  was  filled  out  only 
in  the  administration  immediately  following  treatment 
(designated  by  "X"). 
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B.  SUBORDINATE  ORGANIZATION  SURVEY 

This  questionnaire  was  given  to  subordinates  of  the 
supervisors  who  were  trained  or  scheduled  to  be  trained  as 
part  of  the  study  to  measure  how  supervisors  in  the  Coast 
Guard  work  with  their  subordinates.  The  first  five  ques¬ 
tions  asked  for  some  biographical  data  of  the  survey 
respondents.  SUBQ106A  through  SUBQ108C  asked  for  the 
subordinates'  attitudes  or  opinions  about  what  it  is  like 
to  work  in  the  Coast  Guard.  The  remaining  questions  dealt 
specifically  with  how  the  subordinates'  supervisors  and 


others  work  with  them. 


A  D 


UNIT 


US 


(  o  —  9 ) 

i  10) 

!  12-15! 


INTERACT  PESKRMANCE  SfSTQE ,  INC. 
SUBORDINATE  ORGANIZATION  SERVE? 


IMPORTANT  PLEASE  READ 


This  questionnaire  is  being  given  to  you  as  part  of  a  study  to  measure  bov 
supervisors  in  the  Coast  Guard  work  with  their  subordinates.  There  are 
three  parts  to  this  questionnaire-  Part  I  asks  you  some  basic  questions 
about  yourself.  This  helps  us  make  sure  that  different  units  in  the  Coast 
Guard  are  Included  in  a  fair  way.  Part  II  aaks  for  your  attitudes  or 
opinions  about  what  it's  like  to  work  in  the  Coast  Guard.  Part  III  asks 
very  specific  questions  about  how  your  supervisor  and  others  work  with  you. 

All  of  your  answers  will  be  strictly  confidential.  Only  the  researchers  at 
Interact  Performance  Systems  will  have  access  to  your  questionnaire. 

This  questionnaire  will  be  repeated  in  a  few  months,  and  we  would  like  to 
learn  your  views  at  both  times.  In  order  to  follow  your  responses  over  the 
months  and  at  the  same  time  make  sure  you  remain  anonymous,  we  adc  that  you 
code  each  questionnaire  in  the  following  way: 

1.  Print  the  first  letter  of  your  Mother's 

first  name .  ■  >  _____ 

2.  Print  tne  first  letter  of  your  Father's 

first  name .  _ 


3.  Print  the  two  numbers  which  represent  the 
day  of  the  month  of  your  birthday  .  .  , 

Please  note  example: 

If  your  mother's  name  is  Mary  Snith . 


( 12-20 ) 


If  your  father's  nane  is  Robert  Smith  put  an  R 
in  the  space .  Please  do  cot  put  a  B  even  if  his 
nickname  is  Bob  . 


If  you  were  born  cn  the  16th  of  the  month.  . 
Or  if  you  were  born  on  the  5th  at  the  month. 


R 

_1 

0 


(Please  Include  a  aero  In  the  first  space  if  you  were  born  before  the 
10th  of  the  month.) 


Name  of  your  current  supervisor: 


121-24) 


Reprinted  V!ich  Permission 
Copyright,  Interact  ?e-formance  Systems.  Inc.  1982 

"  i  1  acSc'vCJ 


1 


78 


INSTRUCTIONS 


1.  Most  questions  can  be  answered  ty  choosing  one  of  the  answers  given.  If 
you  do  not  find  the  exact  answer  that  fits  your  case,  choose  the  one 
that  is  closest  to  it. 


2.  Answer  questions  by  circling  the  number  of  your  answer  choice,  as  shown 
In  this  example. 


Q:  To  what  extent  are  you  sit is fled  with  the 

car  you  drive?  1  2  3  4  (?)  6  7 

(A  response  of  S"  would  mean  that  you  are  satisfied  with  the 
car  you  drive  somewhere  between  "some  extent'"  add  "great 
extent"  but  closer  to  "some  extent.") 


3.  Be  sure  each  answer  Is  clearly  larked. 


PLEASE  AN3WER  EV1HY  QUESTION 
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«r 


» 


E 


PART  I 


SUBQ1Q1 
1.  Age? 


■aU  BO  10?. 
2.  Sex? 


Page  3 


a. 

under  20 

f. 

40  to  44 

b. 

20  to  24 

&* 

45  to  43 

c. 

2S  to  29 

C-- 

30  to  -'4 

d. 

30  to  34 

1. 

55  and  over 

o. 

35  To  39 

(25) 


a-  Female 
b.  Hale 


SU3Q103 

3.  Years  In  the  Coast  Guard? 


(PS) 


a. 

Less  Than  1  ' 

f.  5  to  7 

b. 

One 

g.  8  to  10 

c. 

Two 

h.  11  to  15 

d. 

Three 

i.  More  than  15 

e* 

Four 

SUBQ104 

4.  Years  In  current  assignment? 

a. 

Less  than  L 

t.  5  to  7 

b. 

One 

g.  8  to  10 

c. 

Two 

b.  11  to  15 

d. 

Three 

1.  More  than  15 

e. 

Four 

SLBQL05 

5.  Time  spent  worsting  for  your  current 

supervisor? 

a. 

Leas  than  3  months 

f.  5  to  7  years 

b. 

3  to  6  months 

g.  8  to  10  years 

c. 

7  to  11  months 

b.  11  to  15  years 

d. 

1  to  2  years 

i.  More  than  15  years 

4 

O  * 

3  to  4  years 

(27) 


(28) 


(29) 
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Pane  4 


PART  II 


This  part  of  the  survey  contains  questions  about  what  It's  like  to  work  for 
the  Coast  Guard.  Once  a^.lx,  your  .espouru**  *111  he  ooniidentls.1. 


to  «hat  extent; 

BQ10B.  a.  Do  the  supervisors  and  those  senior  to  thcx 
at  thus  unit,  have  an  interest  in  the  eel  1 
being  and  morale  of  the  people  ”ho  work  be-re* 


1  2 


j 


3  4  5  6  7 


(30) 


SUBQlOfab.  Do  the  supervisors  and  those  sen' or  to  them 
at  this  unit  try  to  lap  rove  working 

conditions?  J  234507 


3llBQ106c.  Do  your  supervisors  and  those  senior  to  then 
at  this  unit  schedule  the  work  that  needs  to 

be  done  with  the  subordinates  In  mine?  i  l  3  4  5  6  7 


SUBQlOud.  Do  you  feel  motivated  to  give  your  best 
effort  to  the  Coast  Guard? 


2  3  4  5  6  7 


3UBQ106te.  Do  people  who  do  the  most  on  their  jobs  get 
rewarded  the  met? 


2  3  4  5  6  7 


S'JBQ106f.  Are  there  things  about  working  here  that 

encourage  you  to  work  hard?  1234507 

SUBQ106g.  Are  decisions  regarding  the  way  work  gets 
done  made  ty  those  who  have  the  best 

information?  1234567 


SCBQ106h.  Is  information  In  this  unit  widely 

shared  so  that  those  who  make  decisions 
have  access  to  all  available  know-how? 


S’JBQlOhi.  is  the  amount  of  information  you  get  about 
what  is  going  cc  In  your  division  adequate 
for  you  to  do  u  better  Job? 

SUBQ106J.  Do  you  get  the  Information  you  need  about 

your  own  Job  In  order  to  do  your  Job  in  the 
best  way? 

Sl!BQ106k,  is  your  supervisor  willing  to  listen  to  your 
Ideas  and  suggestions? 

SUEQ1061.  Are  those  aberw  your  supervisor  open  to  your 
Ideas  and  suggestions? 


1  2  3  4  5  6  7 

1  2  3  4  5  6  7 

1  2  3  4  5  0  7 

1  2  3  4  5  6  7 

1  2  3  4  5  6  7  (41) 
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SUSQ106  “• 
SCBQ106  »• 

All  in 
S'JBQIO  7.  a. 
SUBQlOTb. 

SOBQ107c. 

S'JBQlQ7d. 

SUBQlO’o. 

SL'EQ107f. 


to  wha 

S'u'BQlO  8.  a- 

SI'  SQ  108*3. 

SUBQlOBc. 


> 
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Are  problem  discussed  In  a  profess  total  and 
helpful  Banner? 

Do  supervisors  and  those  senior  to  them  shoe 
concern  and  understanding  for  people  when 
talking  about  problem? 


2  3  4  5  6  7 


1  2  3  4  5  6  7 


(42) 


all,  boe  satisfied  are  you  with: 

The  people  In  your  division? 

11th  people  in  the  Coast  Guard  wfto  are 
outside  your  division? 

With  your  supervisor? 

With  your  Job? 

With  your  pay? 

With  the  way  problem  get  solved  in  your 
division? 


1  2  3  4  5  0  7 

1  2  3  4  5  6  7 

1  2  3  4  S  6  7 

1  2  3  4  5  6  7 

1  2  3  4  5  0  7 

12  3  4  5  6  7 


eateot: 

Would  you  oonalder  taking  a  Job  similar  to 
the  one  you  now  have  (outside  the  Coast  Guard), 

In  the  meat  city,  with  no  loss  of  benefits, 

and  with  a  10*  rales  in  pay?  1  2  3  4  5  6  7 

Are  you  glad  you  choae  the  Coast  Guard  for 
a  career  over  the  otuer  carter  opportunities 

you  aught  have  bad?  1  2  3  4  5  6  7 

Are  you  oomdtt  >1  to  working  .'or  the  Coast  Guard 
as  long  as  your  personal  situation  (your 
baaltj.  spouse's  or  family '■  needs,  etc.) 

all owe  you  to?  1234567  (52) 


» 


I 


» 


8? 


Pigc  6 


PART  III 


The  last  section  focused  on  your  opinions  and  feelings.  This  section 

focuses  on  your  observations. 

The  following  questions  refer  to  how  your  supervisor  deals  with  problems  in 
your  division. 


To  what  extent:  “  * 

I  I 

SUBQ109*  a-  Does  your  supervisor  seep  up-to-date  with 

theproblemsyouare  experiencing  on  the  Job?  1  2  3  4  5  6  7 


(53) 


SUBQ109b.  Does  your  supervisor  take  time  discussing 

your  point  of  view  on  your  work?  1  2  3  4  5  6  7 

SUBQ109:.  Does  your  supervisor  take  tiros  to  a*  you 
whether  there  are  ways  be  or  she  can  help 

make  your  Job  easier?  123456? 

31'BQlO^t.  Does  your  supervisor  came  to  your  work  area 
to  rak  you  whether  you  need  any  help  to  make 

your  Job  easier?  12  3  4  5  6  7 

SUBQlO^e.  Does  a  problan  have  to  get  out  of  hand  before 

your  supervisor  rftooaea  to  deal  with  it?  1  2  3  4  5  6  7 

SUBQ109f.  Does  your  supervisor  fall  to  deal  with 

problems  before  they  became  severe?  1  2  3  4  5  8  7 

SUBQ109*'  Does  your  supervisor  give  you  excuses  for  not 
solving  problems  that  shew  you  he  or  abe 

won’t  "go  to  bat"  for  you?  1234567 

SUBQ109h.  is  ycur  supervisor  unwilling  to  argue  or 

fight  for  you  to  solve  problems  you  bring  up?  1  2  3  4  5  6  7 

SUBQ109i.  Doss  your  supervisor  refuse  to  take  on  the 
people  in  poeur  In  order  to  remove 

complaints  in  your  department?  1  2  3  4  5  6  7 

SUBQ109j.  is  your  supervisor  supportive  in  solving  work 

related  problea  i  you  want  help  with?  1  2  3  4  5  6  7 

SUBQ109k.  Tom  your  supervisor  bring  resourc«B  to  bear 

to  help  ycu  solve  problems  on  the  Job?  1  2  3  4  5  6  7 


(83) 


83 


iua)ia  lfsjQ 
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f 

t 

•» 

f 


SVBQ1091.  Does  your  supervisor  say  he  or  sbe  will  take 
action  oo  a  problem  but  then  never  get  back 
to  you  to  solve  it? 


1  2 


s 

v"* 

3  4  5  6 


(64 1 


SUBQiGSn.  Does  your  supervisor  premise  to  see  what  can 
be  done  about  a  problsn  but  then  never  let 

you  Ifflc*  what  be  or  sbe  did  to  solve  it?  1  2  3  4  5  6  ? 

SUSQlO^h.  Is  your  supervisor  quick  to  follow  through 

on  problems  you  bring  to  his  or  her  attention?  1  2  3  4  5  6  7 

SUBQlOSb.  Does  your  supervisor  take  action  in  a  timely 
way  to  solve  complaints  you  bring  to  his  or 

her  attention?  1234567 


SUBQ10%>.  Does  your  supervisor  get  on  your  case  too  such 
about  little  things  that  are  not  worth  the 

time  they'd  take  to  fix?  1  2  3  4  5  0  7 


10.  Talking  About  Problems  an  the  Job 

SUBqllOa-  *hen  your  supervisor  brings  up  a  problem, 
to  what  extent  la  be  or  sbe  clear  about 
exactly  whet  «  bothering  him  or  her? 

SUBQllOb.  To  *b»t  ev  .  Is  your  supervisor  clear 
about  thi  Alois  of  problems? 

(That  U  to  what  extern,  does  be  or  she  use 
specific  statements  such  as,  'Tou  filed  the 
Jones  file  under  the  K'a"  instead  of  vague 
statements  such  as,  'Tou  aren't  filing  these 
correctly.") 


1  2  3  4  5  6  7 

1  2  3  4  5  6  7 


11.  Talking  About  Problems 

SUBQ111*-  To  shat  extent  does  your  supervisor  put  you 

down  when  describing  problems?  1  2  3  4  5  6  ? 

SUBQUlb.  To  what  extent  does  your  supervisor  draw 
conclusions  about  you  as  a  person  when 

discussing  problems?  1234567  (72) 

(That  is,  to  what  extent  does  he  or  the  say 
thiry  about  you  like,  'Tou 1  re  lazy,  you've 
got  a  tad  attitude,  you're  loccnpetent , " 
instead  of  Just  describing  what  is  wrong  with 
the  Job?) 


» 


►  a 
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12.  Listening  to  You 

When  you  talk  with  your  supervisor  about  work, 
to  what  extent  does  he  or  she: 

SUEQU2a.  Listen  to  your  point  of  view  without 
interrupting  or  cutting  you  off? 

SU6Q112  b.  Demonstrate  by  restating  that  he  or  she 

fully  understands  the  point  you  are  trying 
to  make? 


12  3  4  5  6? 

1  2  3  4  5  6  7 


SUBQ1 1 2  c.  Accurately  suntnarlze  your  feelings  oo  the 
matter? 


2  3  4  5  0  7 


SUBQ112  d.  Carefully  listen  without  arguing  or  becoming 
upset? 


1  2  3  4  5  6  7 


(73) 


13.  a.  To  what  extent  does  your  supervisor  impose  a 
solution  to  a  problem  without  first  stopping 

to  figure  out  what  is  going  oo?  1  2  3  4  5  6  7 


SUBQ113  b.  To  what  extent  does  your  supervisor  "shoot 
from  the  hip"  when  solving  problems  instead 

of  stopping  to  learn  about  the  problem  first?  1234537 


SUBQll'3 


To  what  extent  does  your  supervisor  blame  you 
for  problems  that  aren't  your  fault? 


2  3  4  5  6  7 


SU30.11 3  d.  When  discussing  a  problem  with  you,  tc  what 
extent  does  your  supervisor  assume  you're 

the  cause  of  the  problem  when  you're  not?  12  3  4  5  6  7 


(80) 


CARD  2 1 


14.  Explaining  the  Reasons  Why  Something  Must  be  Done 
a  Certain  Way 

SUBQ114**-  When  discussing  a  problem,  to  what  extent 
4am  your  supervisor  clearly  explain  what 
would  S3  wrong  with  the  Job  if  the  problem 

weren't  corrected?  1234587  (23) 


SUBQll^b. 


To  what  extent  does  your  supervisor  explain 
how  correcting  a  problem  affects  the  Job? 


2  3  4  5  8  7  (26) 
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15.  Answering  Questions  About  Why  Something  Must  he 

Done  a  Certain  Way 

SU BQ 1 1 5  a *  *^ea  answering  questions  about  why  something 
mist  bo  done  a  certain  way.  to  what  extent 
does  your  supervisor  order  you  to  do  it  the 
way  be  or  abe  wants? 

SUBQllSb.  When  answering  questions  about  why  something 
oust  be  done  a  certain  way,  to  what  extent 
does  your  supervisor  threaten  you  with  what 
might  happen  if  you  don't  do  what  be  or  she 
wants? 


1  2  3  4  5  6  7 


1  2  3  4  5  6  7 


SUBQ115C‘  1110(1  answering  questions  about  why  something 
Bust  be  done  a  certain  way,  to  what  extent 
does  your  supervisor  use  his  or  her  "stripes" 
as  your  supervisor  to  get  you  to  do  what  he 

or  sbe  wants?  1  2  3  4  5  6  7 


(27) 


16-  Respecting  your  Ideas 

SUBQ116a.  To  what  extent  does  your  supervisor  treat  you 
in  a  way  that  shows  he  or  she  values  your 
experience  and  opinions  on  the  Job? 

SUBQ116b.  To  what  extent  doss  ycur  supervisor  show 

respect  for  your  ideas  and  abilities  on  tbs 
job? 


1  2  3  4  5  6  7 

1  2  3  4  5  6  7 


17.  To  what  extent: 


SUBQ117a.  Does  your  supervisor  try  to  find  ways  to 
asks  the  job  easier  In  tbs  future? 


SUBQ1 17b. 


Is  your  supervisor  coocerned  about  caking 
the  Job  less  difficult  tbs  next  time  you 
have  to  do  it? 


1  2  3  4  5  6  7 

1  2  3  4  5  6  7  (33) 
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18.  After  you  and  your  supervisor  have  discussed  a 
problem,  to  what  extent: 

SUBQ113a.  Does  your  supervisor  leave  you  guessing  about 

That  should  happen  next?  1234567  (34) 

SUBOll8b-  ^  left  unclear  as  to  who  will  do  what  to 

solve  the  problem?  1  2  3  4  5  6  7 

SUB01 18c'  Cajl  y°u  sure  that  your  supervisor  will 
v  really  followup  to  see  that  the  problem  is 

solved?  1234567 

ojjqQi  igd.  Are  you  able  to  trust  that  your  supervisor 
v  will  do  what  the  two  of  you  have  agreed 

needs  to  be  done?  1  2  3  4  5  6  7 


19.  Dealing  with  an  Upset  Subordinate 

St!  BO  11 9*"  ®beo  dea’*-ln*  wl-tb  40  -*PSet  subordinate, 

^  1  to  what  extent  does  your  supervisor  get 

angry  him  or  herself?  1  2  3  4  5  6  7 

SIT  i b.  When  dealing  with  an  upset  subordinate, 
to  what  extent  doe6  your  supervisor 

get  into  an  argument?  1234567 

SUBQ119c.  When  dealing  with  an  upset  subordinate, 
to  what  extent  does  your  supervisor  ask 

what  has  made  the  person  upset  or  angry?  1234567 

SU8Q119d.  When  dealing  with  an  upset  subordinate, 
to  what  extent  does  your  supervisor 
ask  the  parson  what  Is  bothering  him 

or  her?  1  2  3  4  5  6  7  (41) 
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20.  Doing  Well  on  the  Jot  2 

<• 

SG3Q120*.  When  you  have  done  well  on  the  Job,  to  what  | 
extent  does  your  supervisor  simply  ignore 
what  you  have  done?  1  234567  (42) 

SUBQ12Q&*  When  you  have  done  a  good  Job,  to  what  extent 
does  your  supervisor  express  bis  or  her 

appreciation  for  what  you  have  done?  1234567 


21.  To  what  extent: 

SUBQl21a.  Does  your  supervisor  act  in  ways  that  lake 
it  hard  to  trust  him  or  her? 

SUBQ121b.  Does  your  supervisor  tell  you  whatever  he  or 
she  thinks  you  want  to  bear  In  order  to  get 
you  to  do  what  he  or  she  wants? 


1  2  3  4  5  6  7 

1  2  3  4  5  6  7 


(45) 
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C.  SUPERVISORY  ORGANIZATION  SURVEY 


This  questionnaire  was  given  to  supervisors  who  were 
trained  or  scheduled  to  be  trained  as  part  of  the  Problem 
Solving  Skills  .for  Managers  Training  Program.  The  first 
five  questions  asked  for  some  biographical  data  of  the 
survey  respondents.  SUPQ106A  through  SUPQ108C  asked  for 
the  supervisors'  attitudes  or  opinions  about  what  it  is 
like  to  work  in  the  Coast  Guard  (i.e.  Organizational 
Climate,  Satisfaction  and  Commitment).  The  remaining 
questions  dealt  with  the  supervisors  knowledge  of  problem 
solving  and  their  perceptions  of  organizational  support. 
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uscc- 

S  C  p  Q 

admin _ 

UNI?  _  _  _  _ 

INTERACT  PERFORMANCE  SYSTEMS ,  INC. 

SUPERVISORY  ORGANIZATION  SURVEY 


( 12—1-' 


IMPORTANT  PLEASE  READ 

This  questionnaire  is  being  given  to  you  as  part  of  a  study  to  measure  your 
opinions  and  observations  about  your  work.  AU  your  answers  will  be 
strictly  confidential.  Only  the  researchers  at  Interact  Performance  Systems 
will  have  access  to  your  questionnaire. 

This  questionnaire  will  be  repeated  in  a  few  months,  and  we  would  like  to 
learn  your  views  at  both  times.  In  order  to  do  this,  please  print  your  name 
In  the  space  below. 


Name: 


(17-2C) 


> 


» 


Once  again,  only  the  researchers  at  Interact  Performance  Systems  will  have 
access  to  your  survey. 


i 


I  • 


Reprinted  Witn  Permission 
Cooyrijrt.  Irtoract  Performance  SyJttej.  (nc..  1902 
aii  atjnts  ««ier»ta 


»  « 


>  <1 


»  « 
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IMTTRUCriONS 


1.  Most  questions  can  be  answered  by  choosing  one  of  the  answers  given.  If 
you  do  not  find  the  exact  answer  that  fits  your  case,  choose  the  one 
that  is  closest  to  it. 


2.  Answer  questions  by  circling  the  number  of  your  answer  choice,  as  shown 
in  this  example. 


Q  To  ahat  extent  ure  you  satisfied  with  the 

car  you  drive?  1234  (T)  6  7 

(A  response  of  "5"  would  mean  that  you  are  satisfied  with  the 
car  you  drive  somewhere  between  "some  extent"  and  "great 
extent"  tut  closer  to  "some  extent.") 


3.  Be  sure  each  answer  is  clearly  marked. 


Pl£ASt  AN5TCK  EVgg  QUESTION 
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PART  I 

SUPQ101 

1.  Age?  (25) 


a. 

under  20 

f. 

40 

to  44 

b. 

20  to  24 

g- 

45 

to  49 

c- 

25  to  29 

h- 

50 

to  54 

d. 

30  to  34 

1. 

55 

and  over 

e. 

35  to  39 

a.  Female 

b.  Male 


(26) 


SUPQ103 

3.  Years  In  the  Const  Guard 


Less  than  1 

f . 

5  to  7 

b. 

One 

g- 

8  to  10 

c. 

Two 

b. 

11  to  15 

d. 

Three 

1. 

More  than  15 

e. 

Four 

SUPqiOh 

"5!  Years  in  current  assignment? 

a.  Less  than  1 

b.  One 
C.  Two 

d.  Three 

e.  Pour 


(28) 

t  .  5  to  7 

g.  8  to  10 

h.  11  to  15 

1.  More  than  15 


SUPQ105 

5.  Time  spent  working  for  your  current  supervise  •? 


a* 

Lass  than  3  months 

f. 

5  to  7  years 

b. 

3  to  6  months 

8- 

8  to  10  years 

c. 

7  to  11  months 

h. 

11  to  15  years 

d. 

1  to  2  years 

1. 

More  than  15  years 

e. 

3  to  4  years 

(29) 
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PART  II 

This  part  of  the  survey  oontains  questions  about  what  it's  like  to  work  for 
the  Coast  Guard.  Once  again,  your  responses  will  be  confidential. 


To  what  extent: 

SUPQ10  6.  a.  Do  the  supervisors  and  those  senior  to  them 

s  at  this  unit  have  an  Interest  in  the  well 

being  and  morale  of  the  people  who  worn  here? 

SUPQ106b.  Do  the  supervisors  and  those  senior  to  them 

at  this  unit  try  to  improve  working  conditions? 

SUPQlOfcc.  Do  the  supervisors  and  those  senior  to  them  at 
this  unit  schedule  the  work  that  needs  to  be 
done  with  the  subordinates  in  mind? 

SUPQ106d.  Do  you  feel  motivated  to  give  your  best 
efforts  to  the  Coast  Guard? 

Sl!PQ106e.  Do  people  who  do  the  most  on  their  Jobs  get 
rewarded  the  most? 

SUPQ106I.  Are  there  things  about  working  here  that 
encourage  you  to  work  hard? 

SUPQl06g.  Are  decisions  regarding  the  way  work  gets 
done  made  by  those  who  have  the  best 
information? 

SUPQ106h.  Is  information  In  this  unit  widely 

shared  so  that  those  who  make  decisions 
have  access  to  all  available  know-how'’ 

SUPQIO61.  Is  the  amount  of  information  you  get  about 
what  is  going  on  in  your  division  adequate 
for  you  to  do  a  better  Job? 

SUFQ106J.  Do  you  get  the  information  you  need  about 
your  own  Job  in  order  to  do  your  Job  in 
the  best  way? 

SUPQ109t.  Is  your  supervisor  willing  to  listen  To  your 
ideas  and  suggestions? 

SUPQ1Q61.  Are  those  above  your  supervisor  open  to  your 

Ideas  and  suggestions? 


1  2 

12  3 


1 

Vi 

3  4 


5  6? 


4  5  6  7 


1  2 

1  2 

1  2 
i  2 


3  4 

3  4 

3  4 

3  4 


6  7 


6  7 


6  7 


1  2  3  4  5  6  7 


2  3  4  5  6  7 


1  2  3  4  5  6  7 


1  2  3  4  5  6  7 


1  2 


1  2 


4  5 


4  5 


(30) 


(41) 
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C  5 

SUPQ106  m.  Are  problems  discussed  in  a  professional  and 

helpful  Banner?  l  2  3  4  5  6 

SUPQ106  o.  Do  your  supervisors  and  thoee  senior  to  them 
show  concern  and  understanding  for  people 

when  talking  about  problems?  123456 


All  In  all.  bow  satisfied  are  you  with: 

S’OPQIO?.  a.  The  people  in  your  division? 

SUPQ107  b.  With  people  in  the  Coast  Guard  who  are  out- 
sluc  your  division? 

SUPQ107  c-  With  your  supervisor? 

SUPQ1Q7  d.  With  your  Job? 

Sl'PQlO'  e-  With  your  pay? 

St'PQlO?  f.  With  the  way  problems  get  solved  in  your 
division? 


■°  £  5 

I  5  g 

1  2  3  4  5  6  7 

1  2  3  4  5  6  7 

1  2  3  4  5  6  7 

1  2  3  4  5  6  7 

1  2  3  4  5  6  7 

1  2  3  4  5  6  7 


To  what  extent: 

SUPQ108.  a-  Would  you  ooosider  taking  a  Job  similar  to 

the  one  you  now  have  (outside  the  Coast  Guard), 
in  the  same  city,  with  do  loss  of  benefits, 

and  with  a  101  raise  in  pay?  1  2  3  4  5  6  7 

SUPQ108b.  Are  you  glad  you  chose  the  Coast  Guard  for 

a  career  over  the  other  carreer  opportunities 

you  might  have  had?  1  2  3  4  5  6  7 

SUP0108C-  Are  you  canal tted  to  working  for  the  Coast 
Guard  as  long  as  your  personal  situation 
(your  health,  spouse's  or  family's  needs, 

etc.)  allows  you  to?  1234567  (52) 
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This  part  of  the  survey  contains  questions  about  different  approaches  you 
might  use  to  solve  problems  on  the  job.  Different  training  programs 
recommend  different  approaches  to  solving  problems,  but  we  are  Interested  in 
your  opinion  as  to  which  approaches  you  find  useful  in  the  Coast  Guard. 


1.  When  beginning  a  problat  solving  discussloo  with 
a  subordinate,  to  what  extent  do  ycu  feel  It  is 
useful  to: 


S(.'PQl09a.  Begin  the  discussion  By  noting  what  the  sub¬ 
ordinate  is  doing  well  before  bringing  up 
the  problem? 


SDPQlQ9b-  Begin  by  discussing  the  facts  and  details  of 
the  problem  so  that  you  won't  get  Into  an 
argument  about  what  happened? 


SUPQ109C-  Begin  the  discussion  by  asking  what  is  going 
or.  so  that  the  subordinate  will  feel  free  to 
discuss  his  or  her  concerns? 


12  3  4  5  6  7  (531 


1  2  3  4  5  6  7 

1  2  3  4  5  6  7 


2.  To  help  a  subordinate  overcome  a  problem  that  is 
preventing  him  or  her  from  doing  his  or  her  Job, 
to  what  extent  dc  .ou  feel  it  Is  useful  to  start 
by: 


SUPQ1101-  Finding  someone  with  more  experience  or  know¬ 
ledge  than  the  subordinate  to  help  him  or  her 

with  the  job?  1234567 


SUPQllCb.  Asking  the  subordinate  what  he  or  sbe  thinks 
Is  the  best  way  to  solve  the  problem? 


2  3  4  5  6  7 


SUPQ1 1 CF-  Dsia?  your  own  skill  to  decide  what  needs  to 
be  done  and  have  the  subordinate  do  it? 


2  3  4  5  6  7 


(58) 
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3.  When  subordinates  caaplaln  about  doing  a  job 
that  is  hard  but  neeessay  to  do,  to  what  ex¬ 
tent  do  you  feel  it  is  important  to: 

S'OPQlll  a.  Maintain  control  by  focusing  on  the  specific 

disciplinary  actions  yai  could  take?  1  2  3  4  5  6  ?  (59) 

SUP0111  b-  Remind  than  they  work  under  you  and  that  it's 

'  your  Job  to  make  the  decisions?  1234567 

SUPQ111  c.  Stay  on  top  of  the  situation  by  telling 

them  that  they  must  do  the  Job  the  way  ycxi 

tell  them  to?  1  2  3  4  5  6  7 

SUPQ111  d.  Let  them  know  you  will  help  them  later  if 

they  help  you  now?  1234567 

Sl'PQllle.  Promise  them  some  sort  of  reward  for  putting 

out  the  extra  effort?  1234567 

SUPQ111  f.  Remind  them  of  what  could  happen  to  the  Job 

if  they  do  not  put  out  the  extra  effort?  1234567 


4,  When  one  of  your  subordinates  gets  upset  or 
angry,  to  what  extent  do  you  feel  it  is  useful 
to: 

SUPQ1 1 2  Inform  the  subordinate  of  the  disciplinary 
actions  you  will  take  if  he  or  she  doesn't 

control  his  or  her  tender?  1  2  3  4  5  6  7 

SUPQ112b-  Aak  the  subordinate  to  cool  off  before 

discussing  the  natter  with  you?  1  2  3  4  5  6  7 

STJPQ112C.  Ask  the  subordinate  to  go  for  a  walk,  get  a 
drink,  or  take  a  break  so  that  he  or  she 
will  be  leas  emotional  when  you  discuss  the 

problem?  1234567 

SUPQiiid.  Avoid  getting  Into  the  subordinate's  emotions 

by  focusing  on  the  Job?  1234567 

SUPQ112®*  A*  for  stalls  about  what  is  making  the 

subordinate  upset?  1  2  3  4  5  6  7 

SUPQ112*-  Tell  the  subordinate  you  have  felt  the  same 
way  before  and  that  you  sympathize  with  his 

or  her  anger?  1234567  (70) 
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5.  When  you  have  to  deal  with  a  tough  problax  or  a 
touchy  situation  with  one  of  your  subordinates, 
to  what  extent  do  you: 

SL'PQllJa.  Feel  stress  or  tension? 

SUPQlldb.  Feel  confident  and  sure? 

SUPQ113c.  Feel  annoyed  or  Irritated? 


i 

1  2 


3  4  5  6  7 
1  2  3  4  5  6  7 
1  2  3  4  5  6  7 


(71) 


6.  To  what  extent  do  your  subordinates: 

SUPQ114a.  Create  problem  you  have  to  solve? 

Sl!PQll4b.  Need  to  te  watched  If  they  are  to  put  out 
their  beat  effort? 


1  2  3  4  5  6  7 

1  2  3  4  5  6  7 


SUPQ114C.  Need  to  be  told  what  to  do  next  on  the  lob? 

SUPQll4d.  Lack  the  ability  or  experience  to  do  their 
Jobs  without  your  guidance? 


1  2  3  4  5  6  7 

1  2  3  4  5  6  7 


SUPQU4e-  Try  to  appear  "innocent"  instead  of  taking 

responsibility  for  problem  they  have  caused? 

I 

SUPQ114*'  Glve  questionable  or  unlikely  excuses  to 
avoid  blame? 


1  2  3  4  5  6  7 

1  2  3  4  5  6  7 


SUPQ114*'  Try  to  undermine  your  respect  and  authority? 

SUPQ114h.  Act  In  ways  that  question  your  leadership? 

SUPQliil,  Take  offense  at  little  things  that  shouldn't 
matter? 


1  2  3  4  5  6  7  (80) 

re/oaii 

1  2  3  4  5  6  7  (25) 

1  2  3  4  5  6  7 


SUPQ1 14j  •  Get  angry  or  defensive  without  good  reason? 

SUPQ114k-  G®*  frustrated  too  easily  when  a  difficult 
Job  nust  he  done? 

SUPQ1141.  Try  to  take  advantage  of  you  If  you  try  to 
be  their  friend? 


1  2  3  4  5  6  7 

1  2  3  4  5  6  7 

1  2  3  4  5  6  7  (29) 
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6.  To  what  extent  do  you: 

SUPQ116  a.  Set  aside  extra  tine  each  cSay  to  ask  sub¬ 
ordinates  about  problems  in  their  work  areas?  1  2  3  4  5  6  ? 

SUPQ116  b-  Sit  down  and  plan  how  you  will  solve  a  prob¬ 
lem  with  a  subordinate  before  going  out  and 

solving  it?  123450? 

SUPQ116  c.  Rehearse  in  your  mind  what  you  will  say  to  a 
1  subordinate  before  starting  a, problem-solving 

discussion'  1234567 

SUPQ116  d.  Pause  to  list  in  your  bead  what  the  results 
of  a  problon  might  be  before  discussing  the 

problem  with  a  subordinate?  1  234567 

SUPQ116  e.  Stop  to  think  of  all  tbe  reasons  a  Job  needs 
to  be  done  a  certain  way  before  discussing 

the  Job  with  a  subordinate?  1  2  3  4  5  6  7  (36) 
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9.  To  what  extent  cto  other  supervisors  you  worts 
with: 


SL'PQl  1  Discuss  probletns  with  you  before  the  problem 
gets  out  of  hand? 


S'u'?Qll'b-  ^  lor  your  point  of  view  as  to  *hat  is 
causing  a  problem? 


SUPQ1170-  Work  *1^  you  Instead  of  blaming  you  when 
problems  cane  up. 

SuPQ117d-  Discuss  problems  without  becoming  upset  or 
‘ y  raising  their  voices? 

SUPQ117e.  Show  respect  for  your  experience  and 
expertise? 


SUPQ117f.  Follow  through  on  their  commitments  to  you? 

SUPQ117g.  •'Go  to  bat"  for  you  by  taking  on  others 
when  it  is  required? 


w  C 
m  4< 
« 
L  N 
O  *J 


3  4  5 


(3?) 


1  2  3  4  5  6  7 

1  2  3  4  5  6  7 

1  ?.  3  4  5  6  - 

1  2  3  4  5  6  7 

1  2  3  4  5  6  7 

1  2  3  4  5  6  7 


SUPQ117h.  Take  action  on  problem  that  you  bring  to 
their  attention? 


1  2  3  4  5  6  7 


•  < 


P 


10.  To  what  extent  does  your  supervisor: 

SUPQlli*--  Discuss  problems  with  you  before  the  problem 
gets  out  of  hand? 


1  2  3  4  5  6  7 


SUPQ113>-  Ask  for  your  point  of  view  as  to  what  is 
causing  a  problem? 

SUPQ118:-  *ork  with  you  Instead  of  blaming  you  when 
problem  come  up? 


SUPQ1181-  Discuss  problems  without  becoming  upset  or 
raising  their  voices? 

SUPQlliP-  Show  respect  for  your  experience  and 
expertise? 


SUPQll#*  follow  through  on  their  cental  tments  to  you? 

cnpoiii*-  ’’jo  to  bat”  for  you  by  taking  on  the  others 
y  when  it  is  required'’ 


1  2  3  4  5  6  7 

1  2  3  4  5  6  7 

1  2  3  4  5  6  7 

1  2  3  4  5  6  7 

1  2  3  4  5  6  7 

1  2  3  4  5  6  7 


SUPQ11&-  Take  action  oc  problem  that  you  bring  to 
their  attention? 


2  3  4  5  6  7  (52) 
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D.  MULTIPLE  CHOICE  QUESTIONNAIRE 

This  questionnaire  was  given  to  supervisors  who  were 
trained  or  scheduled  to  be  trained  as  part  of  the  Problem 
Solving  Skills  for  Managers  Training  Program.  MCQ101 
through  MCQ115  measured  the  supervisors'  knowledge  about 
problem  solving.  The  remaining  questions  dealt  with  the 
supervisors'  recognition  of  opportunities  to  use  problem 
solving  skills. 
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Name: 


A  Z  M  l  N' 


UNIT 


Cl- 14  I 


XOTQUCT  PESTCRMANCE  fffSTEJC 
MULTIPLE  CHOICE  QUESTIONNAIRE 

'  1 6  -  2  0  ' 


Tbe  following  questions  provide  situations  you  might  face 
at  work,  and  give  five  different  ways  you  might  respond  to 
them.  Pick  the  one  best  response  by  circling  the  number 
in  front  of  it. 


MCQ101 

A.  You  notice  a  person  who  has  been  working  for  you  only  a  short  period  of 
time  using  the  wrong  form  for  an  important  report  You  approach  him  or 
her  and  state: 

1.  "Do  you  need  any  help  on  this?" 

2.  'You're  using  the  wrong  form  for  this  report.  Is  there  anything  we 
can  do  to  avoid  this  happening  in  the  future?*' 

3.  "I  notice  you  are  using  the  03  3312A  form  and  this  report  calls  for 

the03  3307  form."  (25) 

4.  "Then  you  use  the  03  3312A  form  we  don't  get  the  Information 
required  by  by  District." 

5.  "Is  there  anything  I  can  do  to  help  you  learn  which  forms  jo  use  for 
tbe  different  reports  you  prepare?" 


MCQ102 

B.  in  Hiking  with  a  subordinate,  you  become  aware  of  a  rather  complicated 
problem.  You  have  a  fairly  good  idea  why  tbe  problem  exists,  but  are 
not  totally  certain. 

1.  'Yew  seem  to  be  having  a  problem  with  ...  Is  it  because  of  .  .  .?" 

2.  'Mere  is  what  I  think  is  causing  the  problem  •  .  .  What  do  you 
think?" 

3.  'Thanks  for  pointing  the  problem  out.  I'll  check  into  it  and  get 

back  with  you  later  this  afternoon."  (26) 

4.  'Thanks  for  pointing  the  problem  out.  Do  you  want  me  to  get  you 
acne  help  to  solve  it?" 

5.  "What  cto  you  think  might  be  causing  this  problem?" 


t  i 
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m^-ot  your  subordinates  finishes  a  complicated  inspection  ahead  of 
schedule  unking  it  possible  for  you  to  get  under  way  ahead  of  tine. 


You  approach  the  subordinate  and  state: 

1.  "Finishing  that  inspection  ahead  of  schedule  really  helped  out. 
What  can  I  do  to  help  you  beat  schedules  in  the  future?" 

2.  "Finishing  that  inspection  this  corning  mde  it  so  I  could  get  under 
way  ahead  of  time.  Thanks." 

3.  "I  really  appreciate  your  finishing  that  inspection  ahead  of 
schedule  this  rooming.  Thanks." 

4.  'Because  of  your  good  attitude,  we  were  able  to  get  under  way  ahead 
of  schedule.  That  was  really  lngortaat  to  the  crew.  Thanks  " 

5.  'You're  a  real  dependable  person.  Being  able  to  depend  on  you  takes 
alert  of  pressure  off  me.  Keep  it  up." 


(27) 


MCQlOk 

D,  You  observe  a  subordinate  using  a  shortcut  to  complete  an  Important 
electrical  test.  After  you  explain  that  failure  to  follow  the  test 
procedures  could  produce  inaccurate  results,  the  employee  says: 

'This  shortcut  won't  make  the  test  all  that  inaccurate, 
and  besides,  we've  gat  such  a  backlog  of  these  tests. 

This  shortcut  really  helpG  i®  out." 

Knowing  that  the  regular  procedures  are,  in  fact,  appropriate  and  that 
you  have  to  motivate  the  person  to  use  them  —  you  respond: 

1.  'You  eeem  upset,  is  it  because  you  feel  the  tests  take  too  much 
time?" 

2.  'Vaybe  these  procedures  are  a  bit  too  rigid.  I'll  check  into  it  and 
let  you  know.'' 

3.  "If  the  tests  are  any  less  accurate  it  could  danage  the  equipme  .t."  (28) 

4.  "Is  there  anything  I  can  do  to  help  you  follow  the  correct 
procedures?" 

5.  "I  know  the  procedures  seem  picky,  but  I'd  really  appreciate  it  if 
you  would  follow  then  exactly." 
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E.  You  observe  that  the  lookout  on  watda  Is  absent-mindedly  staring  at  tie 

deck  rather  than  alertly  scanning  the  horizon.  After  explaining  that 

the  way  he  or  she  is  looking  for  ships  is  not  active  or  alert  enough, 

the  lookout  says:  • 

'Trying  to  keep  a  lookout  here  Is  Just  busy  work.  There 
are  hardly  ever  any  ships  out  here.  Besides,  the  radar 
will  show  what's  out  there  anyway." 

Knowing  that  keeping  an  active  watch  is  important,  you  respond: 

1.  "I  appreciate  that  It's  tough,  but  it’s  your  Job  and  I  have  • 

confidence  you  can  do  It." 

2.  "I  can  9ee  yore  really  bored.  Is  there  anything  I  can  do  to  help 
you  stay  alert? 

3.  '1  understand  your  concern,  but  trust  me,  keeping  an  alert  watch  Is 

critical."  (29) 

4.  "I  know  what  you  mean.  Maybe  we  can  manage  with  Just  the  radar  for  ^ 

a  while." 

5.  "If  you  don't  keep  an  alert  watch  we  could  miss  craft  that  radar 
doesn't  pick  up." 


MCQ106 

t.  A  subordinate  has  Just  come  to  you  with  a  work-related  problem.  The 
subordinate  Is  VHBf  ANGRY  about  the  equipment  he  or  she  has  to  work  with 
and  states: 


'This  w*V  equipment  Is  driving  me  nuts! 
It's  way  too  slew!" 


You  respond 

1.  'That  seems  to  be  the  exact  problem?" 

2.  "That's  making  you  m ad  Is  that  the  equipment  is  slowing  you  down?" 

3.  ’'Could  you  help  me  understand  hr ov  this  could  affect  cur  schedule?"  (30) 

4.  "Is  there  anything  I  can  do  to  help  you  solve  the  problem?" 

5.  'Do  you  think  we  can  gather  information  In  order  to  figure  out  why 
It  Is  slowing  so  nuch?" 
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yiCQlO? 

G.  You  notice  an  experienced  subordinate  involved  In  an  unsafe  work 

practice-  You  approach  him  or  her  and  state:  (I 

1.  ‘This  is  the  third  time  this  week  I've  noticed  you  standing  inside 
the  recommended  sale  distance  of  this  equipment . " 

2.  'You  Shouldn't  be  doing  that.  You  could  get  hurt." 

3.  "If  that  machine  acts  up  it  could  break  your  wrist."  (31) 

ft 

4.  "I'd  really  hate  to  see  you  get  hurt.  Try  to  bs  safer  fran  now  on." 

6,  'You're  world ng  in  an  unsafe  manner  Is  there  anything  we  can  do  so 
It  won't  happen  in  the  future?" 


ft 


MCQ108 

H.  You've  Just  spoken  to  a  subordinate  about  using  an  incorrect  procedure. 

The  suborinate  becomes  furious  and  states: 

"I'm  not  the  only  one  who  does  the  job  this  way!  _ 

Why  pick  on  me?"  p 

You  res*/0;;d: 

1.  "Is  there  a  way  I  can  help  you  so  you  won’t  have  to  use  this 
incorrect  procedure  in  the  future? 

2.  "Using  this  procedure  could  result  in  a  loss  of  water  tight 

integrity."  t 

3.  "I  know  otber  people  do  the  Job  this  way  too,  but  right  now  we're 

talking  about  you."  (32) 

4.  'You  seem  upeet.  Do  you  think  I'm  picking  on  you?" 

5.  "I  can  see  you're  pretty  upset  about  this.  Why  don't  you  take  a 

break  for  a  few  minutes  and  then  we  can  talk  about  it."  § 


ft 
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I.  One  of  th«  best  subordinates  in  your  engineering  department  has  been 
working  for  several  hours  on  a  very  complicated  part  in  the  air 
conditioning  system  and  has  made  little  headway.  You  approach  the 
subordinate  and  he  or  she  snys ■ 

"Let's  see  If  I  can  explain  what's  going  on  here.  The 
lnnsr-f lar.ge  on  this  part  needs  to  be  rounded  to  within 
one  one-thousandth  In  order  to  set  the  bearing  and  seal 
combination.  I've  got  part  of  It  ground  out.  but  the 
ledge  where  the  seal  goes  isn't  right  and  I  need  to  figure 
out  a  way  to  make  a  diagonal  cut  so  that  I  can  get  it  to 
tolerance." 

You  respond 

1.  "Sounds  to  me  like  you've  got  a  good  start  at  solving  the  problem. 
If  you  keep  at  it,  I  have  confidence  that  you'll  be  able  to  solve 
it." 

2.  "I'll  get  another  engineer  to  help  you.  Meanwhile,  you  keep  working 
at  it  so  that  we  can  complete  this  repair  on  achedule  and  meet  our 
cconltment  by  five  tonight." 

3.  "This  problem  sounds  pretty  complicated,  what  do  you  think  is 
causing  it?" 

4.  "It  sounds  to  me  like  you  could  use  some  help  from  the  company  that 
designed  this." 

5.  "Let's  see  If  I  understand.  You've  got  part  of  the  Job  done,  but 
you  are  being  slowed  down  because  of  troubles  in  grinding  out  the 
ledge." 


Answer  the  following  questions  by  circling  the  number  in  front  of 
the  response  that  you  think  best  deals  with  the  situation. 

yicono 

J.  In  observing  a  problem  with  a  subordinate,  it  le  best  to  first: 

1.  Adc  the  subordinate  what  be  or  she  is  doing  and  why. 

2.  Ask  what  you  can  do  to  help. 

3.  Make  the  subordinate  feel  at  ease  by  first  striking  up  a  friendly 
conversation. 

4.  Describe  the  nature  of  the  problem  in  detail. 

5.  Explain  the  consequences  of  what  the  subordinate  is  doing. 


scon;  Page 6 

K.  then  working  with  a  subordinate  In  order  to  find  out  why  a  particular 

problem  be  or  she  faces  exists,  It  is  beet  to: 

1.  Bring  two  or  more  subordinates  together  to  involve  them  all  In 
participative  decision  raking. 

2.  Outline  what  you  think  the  source  o'  the  problem  is  and  ask  the 
subordinate  what  he  or  she  thinks. 

3.  Ask  the  subordinate  if  he  or  she  would  like  you  to  bring  in  an  (35) 
axpert  to  help  solve  the  problem. 

4.  Ask  the  subordinate  what  he  or  she  thinks  the  source  of  the  problem 
is. 

5.  Ask  what  you  can  do  to  help. 

MCQ112 

L.  When  a  subordinate  questions  the  reason  why  something  has  to  be  done  a 

certain  way  (and  you  know  the  reason) ,  It  is  beat  to: 

1.  Explain  the  impact  that  doing  it  the  required  way  has  on  the  way  the 
Job  canes  out. 

2.  Express  your  appreciation  for  the  subordinates  concern,  but  maintain 
your  authority  by  assuring  him  or  her  that  those  who  designed  the 
method  knew  what  they  were  doing - 

3.  Work  with  the  subordinate  in  order  to  determine  what  can  be  done  in  (36) 
order  to  sinplify  making  It  the  required  way. 

4.  Ask  the  subordinate  whether  you  can  help  him  or  her  do  the  Job  In 
the  correct  way. 

5.  Express  your  appreciation  for  the  subordinate's  concern  and  tell  him 
or  her  that  you  will  check  into  the  natter  In  detail. 


MCQ113 

M.  When  a  subordinate  does  an  outstanding  Job,  it  is  best  to  first: 

1.  Indicate  that  you  are  pleased  with  what  be  or  she  had  done  and  that 
you  hope  he  or  she  will  be  able  to  achieve  similar  results  in  the 
future. 

2.  Describe  in  detail  what  the  subordinate  did,  express  your 
appreciation  and  describe  what  happend  as  a  result  of  It. 

3.  Put  the  subordinate  at  ease  by  starting  with  some  ftiendly 

conversation.  (37) 

4.  Express  your  sincere  appreciation  for  what  the  subordinate  did,  and 
explain  what  happened  as  a  result. 

5.  Express  your  appreciation,  describing  what  happened  as  a  result,  and 
tell  them  you're  glad  they  have  such  a  good  attitude. 
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MCQ1U 

N.  In  dealing  with  an  angry  subordinate ,  it  is  beet  to: 

1.  Go  right  to  problem-solving  in  order  to  avoid  having  the  subordinate 
get  mare  and  more  angry. 

2.  Ask  the  subordinate  to  explain  *hat  it  is  that  is  tanking  hits  or  her 

angry. 

3.  Mention  something  the  subordinate  has  done  well  to  show  that  you 

value  him  or  her.  (38) 

4.  Walt  for  the  subordinate  to  calm  mown  and  then  oome  back  and  solve 
the  problan  later 

5.  Maintain  your  control  by  using  a  firm  tone  of  wslce  and  explaining 
the  problems  that  happen  when  a  person  loses  his  or  her  tempe-  on 
the  job. 


MCQ115 

0.  When  there  are  several  possible  ways  to  solve  a  problem  that  a 
subordinate  faces,  and  you  think  that  some  of  them  would  probably  work 
batter  than  others,  it  Is  best  to  first: 

1.  Ask  the  subordinate  for  the  solution  that  he  or  she  thinks  would 
work  best. 

2.  Write  down  the  solutions  that  yew  think  would  work  best,  and  discuss 
them  with  someone  who  has  had  experience  with  similar  problems. 

3.  Express  your  appreciation  for  the  ideas  and  ask  the  subordinate  to 

check  than  out  with  someone  with  more  experience.  (39) 

4.  Act  on  the  solution  that  you  think  is  best  and  have  the  subordinate 
gather  information  about  the  problem  to  make  sure  that  the  solution 
works. 

5.  Call  over  another  su' ordinate  in  order  to  gnin  more  participation  in 
solving  the  problem. 
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At  one  time  or  another,  supervisors  ask  their  subordinates 
for  tbelr  ideas.  In  the  following  questions  we  give  four 
different  reasons  why  a  supervisor  might  ask  subordinates 
for  tbeir  ideas.  Please  read  each  of  the  four  reasons  and 
then  place  a  "1"  by  the  reason  that  best  represents  why 
you  ask  subordinates  for  their  ideas.  TEen  place  a  '2" 
the  second  best  reason,  and  ”3"  by  the  third  best,  and  a 
'•4"  by  the  fourth  best  reason. 


It  is  best  to  ask  subordinates  for  their  ideas  because: 


MCQ116  , 


A.  ¥cu  can  help  subordinates  learn  important  drills  that  they  need 
by  caving  the®  work  through  problems  themselves. 


hCQU6B 

MCQ116C 


H.  Subordinates  can  help  a  supervisor  out  of  a  tough  situation. 

0.  Subordinates  are  acre  likely  to  try  the  solution  if  they  have 
had  a  real  part  in  the  decision. 


MCQ116D 


0.  Since  subordinates  are  closest  to  the  problem,  they  might 
provide  information  you  were  unaware  of. 


It  is  best  to  ask  subordinates  for  their  ideas  because: 

A.  Supervisors  can't  be  expected  to  know  everyth*  ng  about  each  Job, 

'  so  they  need  to  rely  on  subordinates'  ideas. 

8 _  B.  Since  subordinates  are  closest  to  the  problem,  they  probably 

3  have  the  best  infornatlon. 

Z _  C.  Going  to  all  the  trouble  to  Involve  subordinates  can  be  worth  it 

because  subordinates  may  woik  harder  in  the  long  run. 

D _  D.  Subordinates  should  be  Involved  simply  because  they  need  to 

learn  and  grow. 

It  la  best  to  ask  subordinates  for  their  Ideas  because: 

_  A.  You  can  get  subordinates  to  think  of  your  solution  as  their 

A  "own”  idea. 

j _ B.  Even  though  the  ideas  may  be  impractical  or  naive,  It  Is 

ingjortant  for  subordinates  to  feel  involved. 

^  C  You're  more  likely  to  Identify  the  real  problem  If  you  use  the 

subordinates'  expertise. 


2180 - 


D.  Supervisors  are  so  involved  in  managing  that  they  must  rely  on 
the  subordinates  to  work  through  the  problems. 


108 


E.  SUPERVISOR  EVALUATION  OF  TRAINING 

This  questionnaire  was  given  to  supervisors  who  had 
been  trained  as  part  of  the  Pro 'olein  Solving  Skills  for 
Managers  Training  Program.  It  was  designed  to  measure 
the  supervisors'  reaction  to  the  training  program  and 
their  motivation  as  determined  by  intrinsic  and  extrinsic 
factors . 
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INTERACT  PERFORMANCE  SYSTEMS 
SUPERVISORY  EVALUATION  OF  TRAINING  QUESTIONNAIRE 


The  purpose  of  this  questionnaire  is  to  measure  your 
opinion  of  the  Interact  trainm;  propram  you  have  new 
completed.  Your  answers  will  he  kept  confidential,  so 
please  feel  free  to  say  wnat  you  feel. 


Name : 


16-9) 


Once  again,  only  tne  researchers  at  Interact  Performance 
Systems  will  have  access  to  your  survey. 
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I .  How 

use 

SETQIOIa. 

SETQ101B . 
SETQ101C. 
SETQ101D. 

SETQIOI— 

SETQ101f- 

setqioig. 

SETQ101H. 

II.  In 
SETQ102*  • 
SETQ102b. 

SETQ102C. 

SETQ102D. 


well  do  the  skills  work? 

Jhat  extent  are  the  skills  taught 
the  program  effective  when  you 
them  to: 

Begin  discussing  a  problem  with 
a  suDordmate  wno  is  performing 
poorly  on  the  gob? 

Figure  out  why  a  subordinate  is 
not  performing  well  on  the  gob? 

Encourage  a  poorly  performing  sub¬ 
ordinate  to  want  to  work  harder? 

Involve  a  subordinate  In  finding 
a  solution  to  a  tough  problem 
on  the  job? 

Get  an  angry  subordinate  to  calm 
down? 

Help  a  suborniate  see  thac  you 
understand  his  or  her  description 
of  a  complex  problem? 

Figure  out  long-term  solutions 
that  will  keep  problems  from 
coming  up  in  the  future? 

Make  sure  your  subordinate  under¬ 
stands  -exactly  what  you  expect 
him  or  her  to  do  to  solve  a 
problem? 


(1?) 


summary,  to  what  extent: 


Do  you  think  the  skills  taught 
actually  work? 

Do  you  disagree  with  a  lot  of 
wnat  was  taught  in  the  program? 

Are  the  skills  taught  in  the 
program  too  soft  so  that  if  you 
use  them  your  subordinates  will 
take  advantage  of  you? 

Are  the  skills  taught  in  the 
program  too  underhanded  so 
that  if  you  use  them  you  feel 
you  are  taking  advantage  of  your 
subordinates? 


12  3  4  5  6? 

1  2  3  4  5  6  ’ 

1  2  3  4  5  6  ? 

1  2  3  4  5  6  ? 
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III. 


How  worthwhile  we*  the  training? 


e 


t 


To 

tr 

wnat  extent  do  you  think  the 
aming : 

SETQ103  A. 

was  worth  the  time  and  effort 
spent  on  it? 

SETQ103 B. 

Was  an  unpleasant  and  uncom¬ 
fortable  experience? 

SETQ103  C . 

Was  something  you  enjoyed? 

SETQ103 D. 

was  largely  a  waste  of  time 
because  you  had  similar 
training  in  the  past? 

SETQ103E- 

Was  a  waste  of  time  because 
it  was  not  related  enough 

to  the  real  supervisory 
problems  you  face? 

SETQ103F.  Made  you  more  comfortable  with 
the  way  you  have  to  treat  your 
suoordinates  in  order  to  get 
things  done? 

SETQ103G.  Wasted  valuable  time  that  you 
would  rather  have  spent 
elsewhere? 


12  3  15  6? 

12  3  4  5  6  7 


IV.  What  kind  of  impact  did  the  training 
have? 

To  what  extent  do  you  think  the 
training : 

SETQlOi*-  Improved  your  skills  in  dealing 

with  tough  situations  with  your 

subordinates?  1234567 

SETQIO^b.  Was  something  you  were  able  to 

use  on  a  daily  basis?  1  2  3  4  S  6  7 

SETQIO^C.  Was  something  you  didn't  really 

need  because  you  were  satisfied 
with  your  skills  when  the  training 

started?  1234567 

SETQIO^O.  Helped  you  do  a  better  job?  1234567 

SETQ104E"  Benefited  your  suoordinates?  1234567 

SETQlOif-  Increased  the  amount  of  work  your 

suoordinates  do?  1234567 


t  _< 


I 
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V.  How  did  the  other  people  who  were  trained 
in  the  same  workshop  group  as  you  reel 
about  the  program? 

To  what  extent: 


ETQ105A-  Were  others  in  your  training 
group(s)  cooperative? 

ETQ105B.  Were  they  "involved  "  in  the  training? 

■ETQ105C.  Did  they  support  your  efforts  to 
learn  and  practice  the  skills  in 
class? 


•ETQIOS0-  Did  others  take  the  training 
A  seriously? 

■ETQ105e.  Were  others  willing  to  try  out  the 
new  behaviors? 


;ET0105F-  Dl<*  others  seem  to  take  the  training 
'  as  just  a  game? 

;ETQ1053.  Did  others  seem  to  act  as  if  they 

were  only  sitting  tnrougn  the  train¬ 
ing  because  they  were  forced? 

;ETQ105H.  Was  there  an  individual  or  group 

who  resisted  the  program  and  lowered 
the  overall  enthusiasm? 


1ETQ1051-  Did  others  benefit  from  the  program? 

IETQ105J-  Did  others  actually  change  the  ways 
they  work  with  people? 


c 

X 

ll 

0. 

E 

tn 


1  2  3  4  5  6  7 


l  2  3  4  5  6  7 

1  2  3  4  5  6  7 

1  2  3  4  5  6  7 

1  2  3  4  5  6  ' 

1  2  3  4  5  6  7 

1  2  3  4  5  6  7 

1  2  3  4  5  6  7 

1  2  3  4  5  6  7 


VI.  How  did  other  people  in  the  organization 
feel  about  tne  program? 


!ETQ106a. 

;etqio6b. 

5ETQ106C. 

5EIQ106D. 
5ETQ106E- 
5ETQ106f  • 


Did  the  people  above  you  in  the  chain 
of  command  support  the  program? 

Did  other  key  supervisors  support 
the  program? 

Were  your  subordinates  aware  of 
the  training  program  before  it 
began? 

Were  your  subordinates  generally 
supportive  of  the  training  program? 

Did  vour  subordinates  make  fun  of 
your  attempts  to  use  the  skills? 

Did  your  subordinates  support  your 
efforts  to  use  the  skills  witn  them? 


1  2  3  4  S  6  7 
1  2  3  4  5  6  7 

1  2  3  4  5  6  7 
1  2  3  4  5  6  7 
1  2  3  4  5  6  7 
1  3  3  4  5  6  7 
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Cleat  extent 


What  were  the  reasons  for  trving 
the  skills? 


To  wnat  extent  did  you  try  tne 
skills: 


SETQ107  * • 

SETQ107  b. 
SETQ107  c . 

SETQ1070, 
SETQ107  E. 


Because  the  trainers  were  senior  o 

to  you  and  net  because  you  thought  2 
that  the  skills  might  work?  "  1 

Because  the  skills  made  sense?  1 

Because  the  skills  seemed  to  work?  1 

Because  you  felt  comfortable 
using  the  skills?  1 

Because  your  supervisor  supported 
using  the  skills?  i 


VIII.  What  was  it  like  going  through  the 
training? 

SETQ108*-  Overall,  now  would  you  rate  the.  number 
of  training  sessions? 

1.  Too  few. 

2.  About  the  right  number. 

3 .  Too  many . 

SETQ1083.  Overall,  how  would  you  rate  the  pace  of  the 
training? 

1.  Too  alow. 

2.  About  right. 

3.  Too  fast. 


SETQ108C •  Overall,  how  would  you  rate  tne  complexity 
of  the  training? 


1 .  Too  simple  . 

2.  About  right. 

3.  Too  complex. 


I 
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:x.  How  rsccr;  practice  was  done? 

While  you  were  participating  in  training,  on  the  average: 


SETQ109  How  much  time  was  spent 

“  Rehearsal  Cards  in  each 

practicir 

session? 

.9  tiie 

1 . 

Less  than  5  minutes 

5  . 

31 

to 

40 

minutes 

2  . 

5  to  10  minutes 

6  . 

41 

to 

50 

minutes 

2. 

11  to  20  minutes 

7. 

51 

to 

60 

minutes 

4  . 

21  to  30  minutes 

8  . 

61 

to 

70 

minutes 

9  . 

More 

than  70  minutes 

SETQ109B. 

How  many  Rehearsal  Card  situations  did  you  Dractice 
wnen  using  the  cards  in  each  session? 

1 . 

C  to  1  situation 

5. 

8  to  9  situations 

2  • 

2  to  3  situations 

6  . 

10  to  11  situations 

3. 

4  to  5  situations 

7  . 

12  to  13  Situations 

4 . 

6  to  ?  situations 

a . 

14  to  15  situations 

9. 

More  than  15  situations  1 

SETQ109C. 

How 

by 

many  times  a  week 
fulfilling  a  fixed 

d-d  you  practice  using  the  skills 
contract  to  practice? 

1. 

None 

5. 

Four 

2. 

One 

6  . 

Five 

3. 

Two 

7 

Six 

4  . 

Three 

B  . 

seven 

9. 

Eight  or  more  1 

SETQ109D. 

How  many  times  during 
or  place  to  look  for 
contracts) ? 

a  week 
chances 

did  you  set  aside  a  time 
to  use  the  skills  (spontaneous 

1 

A  a 

None 

S. 

Four 

2. 

One 

6  . 

Five 

3. 

Two 

7. 

Six 

4  . 

Three 

8  . 

Seven 

9.  Eight  or  more  >0?l 


IIP 


Pace 


SETQ109Z. 


How  many  times  between  each  session  did  your  trainer  talk 
to  you  about  asm;  the  skills? 


1 

None 

c  _ 

Tour 

2. 

One 

6  . 

Five 

3. 

Two 

7  . 

Six 

4  . 

Three 

e. 

Seven 

9  . 

Eight 

(  70) 


X,  How  many  times  did  you  talk  about  the  Interact  training  program 
outside  of  class  each  week?  (Please  write  the  number  of  times  in 
the  box  to  the  right] 


SETQUOA. 

with 

Other 

people  going  through  traininng? 

□ 

CD 

SETQ1 10  B ■ 

with 

your 

instructor  or  other  instructors? 

□ 

SETQ110C- 

with 

your 

supervisor? 

□ 

SETQ110  o. 

with 

your 

peers? 

□ 

SETQ110E. 

With 

your 

suoordmates? 

□ 

SETQ110  F . 

with 

your 

family? 

□ 

l  76) 

c 

o 

c 

t o 

<11 

mi 

mi 

X 

I  CARD  2) 

X 

0> 

<c 

•  <11 

mi 

JJ 

l 

* 

o 

XI.  Overall: 

0 

z 

0 

CO 

kw 

V 

SETQ111*-  To  what  extent  do  you  value  the 
skills  taught  in  the  program? 


SETQlll0-  To  wh*c  extent  are  you  committed 
x  to  using  the  techniques  in  the 

program?  12345° 


oftoI 1 1 C .  To  what  extent  did  you  become 
"  excited  aoout  using 

the  skills  in  the  program?  1234567 


SETQ111 D.  Tc  what  extent  has  this 

program  interested  you  in 
more  training  of  this 
type? 


1  2  3  4  S  6  7  (20) 
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In  interview*  people  have  told  us  that  they  often  don't  use  the 
skills  from  training  programs  as  often  as  they’d  like.  When 
asked  why,  they  explain  that,  while  they  might  want  to  use  tne 
skills,  at  times  they  "forget.”  They  are  so  used  to  their  old 
ways  of  doing  things,  they  don’t  stop  to  think  about  using  the 
new  skills.  In  this  section  we'd  like  to  ask  you  some  questions 
about  this  problem. 


XII.  Please  think  of  the  times  you  have  used  skills  from  this 
program,  and  where  you  were  when  you  thought  to  use  the 
skills.  We  would  like  to  know  where  people  are  and  what 
they  are  doing  when  they  "stop  and  think"  of  a  chance  to 
use  these  skills.  „ 

o 

a 


How  frequently  have  the  following  state-  — 
merits  been  true  for  you:  e 

SETQ112  a.  During  a  training  aession  I  thought  £ 
of  an  opportunity  to  usa  ona  of 
the  skills.  1  2 


o 

> 

41 

V5 


4  5  6 


c 

CJ 

3 

c* 

& 


>* 

w 

0 

> 

7 


(71) 


SETQ112  b. 

SETQ112  c. 


I  had  sat  aside  a  time  to  look 
for  chances  to  use  the  skills,  and 
during  that  time  1  saw  (or  thought 

of)  a  chance.  1234567 

1  was  not  specifically  looking  for 

a  chance  to  use  the  skills,  but 

saw  a  problem  in  my  work  area  and 

thought,  "This  is  a  chance  to  correct 

that  problem  I've  never  gotten 

around  to  solving."  1234567 


SETQ112  1  didn't  see  the  chance  to  use 
the  skills  at  first,  but  found 
myself  getting  angry  at  someone 
and  that  reminded  me  to  use  the 

skills.  1234567 


SETQ112  •’  1  9ot  halfway  into  a  discussion 

and  taw  that  what  I  had  bagun 
with  wasn't  working  and  that 

reminded  me  to  use  the  skills.  1234567 


SETQ112  f.  i  thought  to  use  the  skills  be¬ 
cause  the  last  time  the  discussion 

had  blown  up  in  my  face  and  i  had  1234567 
said  to  myself,  "Next  time  I'll 
use  the  skills." 


(26 


» 


i 


I 


i 


i 
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XXII.  Whenever  you  cry  something  new,  you  have  to  crncencritt 
...  on  it.  It'*  difficult  and  ycu  have  to  pay  cloae  attention. 

SETQlliA  Wit.",  time,  new  activities  itcome  mere  familiar  and  you 

think  about  them  lass  and  lest.  For  example,  remember 
what  it  was  like  when  you  first  learned  to  drive  a  car? 

It  took  a  lot  of  thought  at  first,  but  with  practice 
became  routine.  Tne  same  is  true  with  new  supervisory 
skills.  The  following  list  describes  different  stages  in 
this  change  process.  Please  check  the  box  (one  only!  t.net 
best  describes  your  useof  the  new  supervisory  skills. 


e.  !  almost  never  use  the  new  skills  without 
'being  aware  of  it'  because  they  are  still 
unfamiliar  and  take  conscious  effort. 

b.  I  occaeionally  use  the  new  skills  without 
'being  aware  of  it'  becauee  they  are 
becoming  more  familiar  and  take  less 
conscious  effort. 

c.  I  frequently  use  the  new  skills  without 
"being  aware  of  it'  because  they  are 
becoming  more  familiar  and  take  less 
conscious  effort. 


d.  1  nearly  always  use  the  skills  without 
"being  aware  of  it"  because  they  are 
quite  familiar  and  take  little  conscious 
effort. 


;  □ 


XIV.  How  frequently  do  you  use  skills  from 
the  training  program.  .  . 

SETQll^a.  At  home  with  your  family? 

SETQll^b.  At  work  with  your  subordinates? 

SETQ114C.  At  work  with  other  supervisors? 

SETQllid.  At  work  with  your  immediate 
supervisor? 

SETQ116*-  In  volunteer  settings  (at 
c.nurcn,  clubs,  etc.) 


4  $  6  7  <28) 


1  2  3  4  5  6  7 

12  3  4  3  6  7 


4  5  6  7 


12  3  4  5  6  7  (32) 


» 


XV.  Kow  frequently  sc  you  use  tne 

different  skills  in  the  program? 


SETQ115*- 
SETQ1 1 5b • 
SETQ1 1 5C • 

SETQ1 1 5d • 
SETQ115e. 


Communicating  the  situation? 
Using  positive  reinforcement? 
Solving  motivation  problems? 
Solving  ability  problems? 
Solving  emergent  problems? 


i  i 


v. 

5) 

E 


1 


a 

> 

v 

•S> 

4 


0 


4> 

> 


3  4  5  6  7 


3  4  5  6  ? 


3  4  5  6  7 


3  4  5  6  7 


(4  J  I 


(37) 


xvi.  Please  rank  order  the  usefulness  of  the  different  skills  in 
the  program.  Place  a  "1"  by  the  skill  you  find  most  useful, 
a  "2"  by  the  second  most  useful,  a  "3"  by  the  third  most 
useful ,  a  *4 " ~ by  tne ~f ourth  most  useful,  and  a  "S”  by'  the 
fifth most  use* u 1 . 


SETQ116  *• 

SE7Q116  b- 
SETQ116  c. 

SETQ116  d. 

SETQ116  e. 


Commcnicati..g  the  situation. 
Using  positive  reinforcement 
Solving  motivation  problems. 
Solving  ability  problems. 
Solving  emergent  problems. 


(38! 


(42) 


XVII.  Please  rank  order  the  training  sessions  by  how  interesting 

they  were  for  you.  Place  a  "1"  by  the  most  interesting  session, 
a  "2"  by  the  second  most  interesting,  a  "3“  by  the  third  most 
interesting  and  a  "4"  by  the  fourth  most  Interesting. 


SETqilTa. 

SETQ11*3- 

SETQll^- 

SETQ117J- 


The  session  covering  communicating 

the  situation  and  positive  reinforcement. 

The  session  covering  motivation  problems. 

The  session  covering  ability  prcDiems. 

The  session  covering  emergent  problems. 


(43) 


(46) 


If  you  were  in  charge  of  the  training  and  interested  in 
getting  people  to  see  all  tne  opportunities  to  use  the  skills, 
what  would  you  do? 
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subs  PART  Ill  FACTOR  ANALYSIS  DOCUMENTATION 


A. 


EIGENVALUES , 


MEANS  AND  STANDARD  DEVIATIONS 


V«rlAbl«  til 

SUB0109A 

SU801090 

SE8Q108C 

SUBQ1090 

SUBQ109E 

SURQI09F 

SU8Q109C 

SU8qi09H 

Sl'#Q109l 

SUBQ109J 

Sl’6Q109K 

SUBQ109L 

SU»qi09M 

SU8Q109N 

SUSQ109O 

$'JBQ109P 

SUBQUOA 

SCBQ110B 

SUBQHU 

SUByi  UB 

SC'BQ  1 1 2 A 

SUbQlUB 

SUBOlUC 

SUB0112D 

SU8Q11JA 

SUBQU3B 

SUSQ113C 

suBQino 

subqika 

SUBQIHB 

SU80115A 

SUBQU5B 

SUBQ115C 

SUBQU6A 

SUBQUbB 

SCBQIHA 

SUBQ1178 

SUBQ118A 

SUBQUBB 

SITWU8C 

SUBQ1180 

SCBQl 19A 

SUBQU9B 

SUBQU9C 

SUBQ1190 

SUB0120A 

SUBQ120B 

SCM12IA 

SUBQ1213 


Ca«aun*llty 

3.37390 
0  -  319  3b 
0.9232b 
0.83103 

0.11539 

0.83852 
0.83904 
0.12915 
0.85362 
0.91061 
0.88108 
0.19981 
0.87280 
0.88205 
0.88980 
0.15559 
0.19539 
0.86515 
0.86396 
0.31902 
0. 19U1 
0.88225 
0.86331 
0.89331 
0.323)3 
0.89439 
0.91828 
0.35808 
0.86641 
0.81806 
0.81595 
0.33638 
0.83551 
0.90301 

o.saaoo 

0.90312 

0.38038 

0.83863 

0.82613 

0.89195 

0.91688 

0.33129 

0.87510 

0.81212 

0.39141 

0.8)110 

0.31)35 

0.14166 

0.84021 


? Actor  ?c t.  or  l££i 


5 

6 
2 
8 
9 

10 

11 

12 

13 

14 

15 

16 
11 
18 

19 

20 
21 
22 
23 

25 

26 

27 

28 

29 

30 

31 

32 
3) 
)3 

35 

36 

37 

38 

39 
30 
.1 
32 

3  3 

4  3 

35 

-6 

38 

39 


22.13053 
-.323)1 
2.37609 
1.59553 
1.50208 
1.27250 
1.20019 
1.13318 
1.061S0 
0.97)99 
0.90176 
0.83351 
0.15969 
0.1)078 
0.66--3 
0.6-2;! 
0.60101 
0.56)33 
0.38110 
0.46129 
31513 
0.37395 
0.3-653 
0 . 30039 
0.27826 
0.236-7 
0.22405 
(3.21877 
0.20107 
0.201)3 
0.U906 
0.16851 
0.15931 
0.1)363 
0.11928 
0. 11-57 
0.10726 
0.09572 
O.QS528 
0.082)4 
0.06805 
0.06236 
0,06002 
0.04696 
0.04262 
0.03023 
0.03589 
0-02325 
0.02716 


«»6 .  •* 

3.9 

2.6 
:5 
2.3 
2.2 
2-0 
l .  B 
1.2 
1  .6 
i-S 

1.1 

1.3 

1.2 
l.V 
\.G 
0.9 
O.a 

o.a 
0.1 
0.6 
0.9 
O.S 
0.3 
0.- 
0.. 
0.* 
o.w 
0.3 
0.3 
0.3 
0.2 
0.2 
0.2 
0 . 2 
0.2 
0.2 
0.1 
0.1 
0.1 
0.1 
Q.l 
0.1 
0.1 
0.1 
0.  I 


C^a.  Pa:  t_. 


^tindird  0«v» 


-6 .  •• 

55.2 
59.5 

62.7 

65.8 

68.3 

70.8 

73.1 
75.) 

17  .3 

79.2 

80.9 

32.4 

83.9 
83) 
86.6 

31.8 
89.0 
90.0 

90.9 
91.7 
92.5 

93.2 

93.3 
94.. 

93.9 

95.3 

95.8 

96.2 
96  .6 
97.0 
91.) 

97.7 

91.9 

98.2 

98.3 
98.6 

98.8 
99.0 

99.2 

99.3 
99.. 

99.5 

99.6 
99.1 
99.3 
99.9 
99.9 

100. 0 


-.3183 

4.-674 

..2500 

4.2500 

3.5761 

3.2717 

3.1196 

3.3387 

3.55-3 

4.6957 

4.-337 

3.3130 

3.4674 

4.2826 

3.2826 
3. 29)5 
-.5000 
4. 5726 
2 . 7 1 74 

3.0435 

4  .6)04 

4.3870 

-.4348 

4.6087 

3.3)10 

2.9891 

2.3132 

2.1)91 

4.5)26 

4.5870 

4.0000 

2.9)48 

2.91)9 

4.641) 

4.7391 

4.4130 

4.0304 

3 . 3804 

3.3) 10 
4.554) 
4.9022 
3.4614 
3.-130 

4.2500 

-..18) 

3.5543 

4. 4) 48 

2.1283 


1.5652 
1 .65)6 
1.3236 
■..•263 
1.7U2 
1.6515 
1.689) 
1.7-52 
1.d796 
1.3100 
1.653) 
1.7675 
1.7)81 
1.6194 
l  .6053 
1.919- 
l  .372- 
1 . 3860 
1.705- 
1.7969 
1 .71- 2 
1.-836 
1.-8-' 
l .7094 
1 .6  226 
1.6206 
1.3213 

l.6b98 

1.-635 

1.38)9 

1.64*2 

1.6495 
1.3111 
1.3869 
1.6)66 
1 .6250 
1.7079 
1.3936 
1.3-26 
1.6111 
I  . 

i.  ci  867 

i.e>:so 

’a.TST'a 

i .ai:* 

\  .  I  U7 
1.7039 


C4HI 

92 

9: 

92 
92 
92 
92 
92 
92 
9 : 

92 

92 

92 

92 

92 

92 

92 

92 

92 

92 

92 

92 

92 

92 

92 

92 

92 

92 

92 

92 

92 

92 

92 

92 

9 1 

92 
92 
92 
92 
92 
92 
92 
92 
92 
92 
92 
92 
92 
92 
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CORRELATION  MATRIX  FOR  VARIABLES 


-r't'  -  -JT  ■Kv^’3  —  —  0«00><n0«  •*  •  f  Q04O0^N0N4  ® 
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